New research from Software Improvement Group measures pandemic impact on software development, reveals effects on developers’ well-being and productivity


Based on nearly 50 billion lines of code across 280+ technologies, the 2021 SIG Benchmark Report reveals improved software build quality worldwide; results from a new study on developers’ pandemic job performance and satisfaction; and impact of ROI-focused technical debt reduction strategies.


Amsterdam, June 24, 2021 – Software Improvement Group (SIG), the independent global authority on software assurance, published today the findings of its third annual Benchmark Report on the state of the global software industry. The report is based on the company’s analysis of nearly 50 billion lines of code across more than 280 technologies, taken from more than 6,000 system assessments worldwide in every major sector.

Less code created during the pandemic, but at higher average build quality level
The 2021 SIG Benchmark Report revealed a decreasing trend for average coding effort throughout the pandemic. At the same time, the overall build quality of code continued an upward trend across all industries and technology stacks. However, data also shows a noticeable decline in build quality performance in the fourth quarter of 2020, possibly caused by the effects of long-term remote work, as discussed elsewhere in the report. According to the report:

Systems monitored by the SIG Sigrid® software assurance platform showed on average a 37% lower coding effort during the pandemic year compared to the previous year. At the same time, however, these systems demonstrated on average a slightly increased maintainability score, the core metric for software build quality. This is largely due to the nature of software becoming easier to change, more modular, and smaller.”

Developers report drop in productivity, job performance
Among the additional highlights of this year’s Benchmark Report were findings from a new joint study by SIG and Leiden University on how the massive shift to remote work has affected software engineers. The study surveyed hundreds of developers across the globe, not necessarily working on systems monitored by Sigrid, to understand how they are coping in home work environments, impacts on their well-being and job performance, and support measures provided by their employers. According to the report:

“The number of developers who reported they weren’t productive for at least some of their time, due to the pandemic, has more than doubled to 60%. Furthermore, developers report working less carefully and with less concentration during the pandemic, indicating two times more often that their work should have been of higher quality. This may explain the decline in software build quality in the last quarter of 2020.

The 2021 SIG Benchmark Report also covers the following topics:

  • Impacts of technical debt on software maintenance costs, with an analysis showing that identifying and renovating only high-ROI systems can make the difference between saving 12% on costs or spending 20% more.

  • Build quality ranking by industry, including the Government, Banking, Insurance, Financial Services, Telecommunications, Software & Computer Services, Energy, Oil & Gas, Media, Health Care, Retail, and Industrial Transportation sectors.

  • Build quality ranking by tech stack, including Low Code, Java/JVM, BPM/Middleware, Microsoft, packaged solutions, scripting and mobile, and legacy/3GL/4GL technologies.


Magiel Bruntink, Head of Research, SIG: “We’re pleased to see that, despite the pandemic, software build quality continues to improve globally, across all industries and technology stacks. However, the report also indicates software engineers’ decreasing productivity and job satisfaction, signaling areas where organizations can improve to ensure productive, satisfied development teams for building and maintaining future-proof capabilities.”

Luc Brandts, CEO, SIG: “For the last three years, SIG has produced the Benchmark Report to provide a comprehensive picture of the state of software development worldwide. While each year brings a set of new challenges, this past year was clearly unlike any other. The new post-pandemic reality will require organizations to leverage healthy software in accelerating digital transformation, and our goal with this year’s edition is to provide them with insights they can apply directly in their own operations to further advance their digital health.”

Request complimentary access to the report.

About SIG
Software Improvement Group (SIG) helps organizations trust the technology they depend on. We combine our intelligent technology with our human expertise to dig deep into the build quality of enterprise software and architecture – measuring, monitoring, and benchmarking it against the world’s largest software analysis database.

The SIG software analysis laboratory is the only one in the world accredited according to ISO/IEC 17025 for software quality analysis. Founded in 2000, SIG is headquartered in Amsterdam, with offices in New York, Copenhagen, Antwerp and Frankfurt.

Learn more: www.softwareimprovementgroup.com
10.06.2024
Reading time: 2-3 minutes

SIG M&A Software Analysis Reveals Concerning Trends In Software Quality

NEW YORK, NY, USA, June 10, 2024

Software Improvement Group (SIG), the leading independent institute specializing in software health analysis, has significant concerns about the quality of software involved in mergers and acquisitions (M&A). Out of 531 M&A-related software projects analyzed, SIG found that the average software quality scores were significantly below the market average. This implies that companies face two times lower development efficiency and a considerably higher risk of defects and vulnerabilities.

Key findings

  • Quality Scores Below Market Average: The study revealed that software involved in these transactions often lags behind industry standards, presenting substantial risks for acquirers.
  • High Technical Debt: On average, technical debt constitutes 31% of the total code volume, indicating severe underlying issues in software maintainability and scalability.
  • Informed Investment Decisions: Companies that utilized SIG’s software economics methodology were able to make strategic investments to mitigate these technical debt challenges effectively.

SIG possesses unparalleled expertise and resources to assess the build quality, scalability, and security of software assets. With the world’s largest software metrics database, encompassing an impressive 200 billion lines of code and 18,000 system inspections spanning over 300 technologies, SIG provides comprehensive evaluations that stand as a testament to our unwavering dedication to creating a healthier digital world.

Luc Brands, CEO of Software Improvement Group: “At SIG, we believe private equity firms are not as in control as they could and should be. Through software economics, we ensure thorough code analysis, benchmarking, architecture investigation, and cost modeling. This approach guarantees clarity regarding the true scalability of acquired assets.”

To further facilitate this conversation, Software Improvement Group and Carnegie Mellon University (CMU) will be hosting a webinar titled “Software Economics for Private Equity: How to Evaluate the Quality and Value of Software Assets” on June 27th. The webinar will provide private equity companies with insights into the importance of software asset valuation. Private equity firms are invited to join the webinar to gain valuable knowledge and insights from industry experts.

In conclusion, software assets represent a significant opportunity for private equity firms to drive value creation. By embracing advanced software economics and leveraging SIG’s expertise, private equity firms can make informed decisions that maximize returns and mitigate risks in their software investments.

For more information about SIG and to register for the upcoming webinar, please visit Software Improvement Group’s webinar page.

For the full report, visit the benchmark report.

About SIG
Software Improvement Group (SIG) leads in traditional and AI software quality assurance, empowering businesses and governments worldwide to drive success with reliable and robust IT systems. Sigrid® – its software excellence platform – analyzes the world’s largest benchmark database of over 200 billion lines of code across more than 18,000 systems in 300+ technologies, and intelligently recommends the most crucial initiatives for organizations. SIG complies with multiple ISO/IEC standards, including ISO/IEC 27001 and 17025, and has co-developed ISO/IEC 5338, the new global standard for AI lifecycle management.
SIG was founded in 2000 and has offices in New York, Copenhagen, Brussels, and Frankfurt, and is headquartered in Amsterdam.

Sigrid®, together with expert consultants, and nearly 25 years of industry-leading research, position Software Improvement Group as the foremost authority on software excellence.

For more information, please visit Software Improvement Group’s website or social media channels.

Experience Sigrid live

Request your demo of the Sigrid® | Software Assurance Platform:
  • This field is for validation purposes and should be left unchanged.

Free AI readiness guide for organizations

Practical steps for executives and IT leaders to successfully implement AI in business