Mining Software Effort Data: Preliminary Analysis of Visual Studio Team System Data
- Lucas Layman ,
- Nachi Nagappan ,
- Sam Guckenheimer ,
- Jeff Beehler ,
- Andrew Begel
Proceedings of the 2008 International Working Conference on Mining Software Repositories |
Published by ACM
In the software development process, scheduling and predictability are important components to delivering a product on time and within budget. Effort estimation artifacts offer a rich data set for improving scheduling accuracy and understanding the development process. Effort estimation data for 55 features in the latest release of Visual Studio Team System (VSTS) were collected and analyzed for trends, patterns, and differences. Statistical analysis shows that actual estimation error was positively correlated with feature size, and that in-process metrics of estimation error were also correlated with the final estimation error. These findings suggest that smaller features can be estimated more accurately, and that in-process estimation error metrics can be provide a quantitative supplement to developer intuition regarding high-risk features during the development process.