Cloud-based software engineering can be faster, more sustainable and energy efficient, states Software Improvement Group in EU-funded research project


Amsterdam – March 21, 2019 – Software Improvement Group (SIG) reports today that new guidelines, methods and datasets have been developed to increase the quality and sustainability of cloud-based software development, as part of the results of European Union-funded research project SENECA.

A European Industrial Doctorate project coordinated by SIG, project SENECA brought together three leading universities and three commercial organizations over the last four years to address key issues in software engineering and computing of cloud-based systems. The project’s recommendations and findings are based on the analyses of hundreds of thousands of lines of code and millions of dependencies in software ecosystems.

Software development processes are relying ever more on cloud-based platforms, with the cloud businesses of leading vendors Amazon and Microsoft seeing revenue growth of 45% and 76%, respectively, in Q4 of 2018. This enormous cloud market growth makes it imperative that software engineers work with scientifically-validated guidelines and sufficient tooling to enhance the quality, maintainability and security of their code and infrastructure while optimizing energy efficiency and CO2 footprints.

From January 2015 to December 2018, the project’s ten PhD research fellows leveraged the vast amount of data available on cloud-based software engineering platforms, such as GitHub, as well as security advisory databases and ecosystems of open source libraries.

The results of project SENECA include:

  • A new code review technique, Test-Driven Review (TDR), to enhance test quality and increase software reliability by employing cloud-based review tools in a new way

  • New guidelines for security code reviews, including the recommendation that at least three people are needed to detect the majority of security issues

  • A new dataset for practitioners, which contains all known security vulnerabilities for the most-reported open-source projects

  • A new catalogue that describes practitioners’ requirements and needs for code review tools, which will be used in future development of new and improved cloud-based tooling

  • New metrics to indicate the amount of technical debt and lag that software incurs over its lifetime, allowing practitioners to increase actionability in library selection and risk prevention in the context of cloud ecosystems of software

  • Task-specific data on the Energy Delay Product (EDP) of programming languages, allowing practitioners to understand the energy consumption of each and select the most sustainable of 14 languages for 25 common tasks


The SENECA consortium consisted of six organizations in both academia and industry: SIG and Delft University of Technology in the Netherlands; Singular Logic and Athens University of Economics and Business in Greece; and Bitergia and King Juan Carlos University in Spain

SENECA provided the research fellows with the opportunity to pursue a PhD in software engineering of systems in the cloud. The project received funding from the European Union’s Horizon 2020 research and innovation program under the Marie Sklodowska-Curie grant agreement No 642954 and was overseen by the Research Executive Agency of the European Commission.

For more information about SENECA, read the interview with Magiel Bruntink, Head of Research at SIG.

About SIG

Founded in 2000, Software Improvement Group (SIG) helps business and technology leaders drive their organizational objectives by fundamentally improving the health and security of their software applications.

SIG combines its proprietary tools and benchmark data with its consultants’ expertise to help organizations measure, evaluate and monitor code quality – whether they’re building, buying or operating software.

An independent organization, SIG has the largest benchmark in the industry with more than 10 billion lines of code across hundreds of technologies. SIG expert consultants use the benchmark to evaluate an organization’s IT assets on maintainability, scalability, complexity, security and other mission-critical factors. The SIG laboratory is the only one in the world accredited according to ISO/IEC 17025 for software quality analysis.

SIG supports customers around the globe in both public and private sectors. The company is headquartered in Amsterdam and New York with regional offices in Copenhagen, Antwerp, Frankfurt and Athens.
10.06.2024
Reading time: 2-3 minutes

SIG M&A Software Analysis Reveals Concerning Trends In Software Quality

NEW YORK, NY, USA, June 10, 2024

Software Improvement Group (SIG), the leading independent institute specializing in software health analysis, has significant concerns about the quality of software involved in mergers and acquisitions (M&A). Out of 531 M&A-related software projects analyzed, SIG found that the average software quality scores were significantly below the market average. This implies that companies face two times lower development efficiency and a considerably higher risk of defects and vulnerabilities.

Key findings

  • Quality Scores Below Market Average: The study revealed that software involved in these transactions often lags behind industry standards, presenting substantial risks for acquirers.
  • High Technical Debt: On average, technical debt constitutes 31% of the total code volume, indicating severe underlying issues in software maintainability and scalability.
  • Informed Investment Decisions: Companies that utilized SIG’s software economics methodology were able to make strategic investments to mitigate these technical debt challenges effectively.

SIG possesses unparalleled expertise and resources to assess the build quality, scalability, and security of software assets. With the world’s largest software metrics database, encompassing an impressive 200 billion lines of code and 18,000 system inspections spanning over 300 technologies, SIG provides comprehensive evaluations that stand as a testament to our unwavering dedication to creating a healthier digital world.

Luc Brands, CEO of Software Improvement Group: “At SIG, we believe private equity firms are not as in control as they could and should be. Through software economics, we ensure thorough code analysis, benchmarking, architecture investigation, and cost modeling. This approach guarantees clarity regarding the true scalability of acquired assets.”

To further facilitate this conversation, Software Improvement Group and Carnegie Mellon University (CMU) will be hosting a webinar titled “Software Economics for Private Equity: How to Evaluate the Quality and Value of Software Assets” on June 27th. The webinar will provide private equity companies with insights into the importance of software asset valuation. Private equity firms are invited to join the webinar to gain valuable knowledge and insights from industry experts.

In conclusion, software assets represent a significant opportunity for private equity firms to drive value creation. By embracing advanced software economics and leveraging SIG’s expertise, private equity firms can make informed decisions that maximize returns and mitigate risks in their software investments.

For more information about SIG and to register for the upcoming webinar, please visit Software Improvement Group’s webinar page.

For the full report, visit the benchmark report.

About SIG
Software Improvement Group (SIG) leads in traditional and AI software quality assurance, empowering businesses and governments worldwide to drive success with reliable and robust IT systems. Sigrid® – its software excellence platform – analyzes the world’s largest benchmark database of over 200 billion lines of code across more than 18,000 systems in 300+ technologies, and intelligently recommends the most crucial initiatives for organizations. SIG complies with multiple ISO/IEC standards, including ISO/IEC 27001 and 17025, and has co-developed ISO/IEC 5338, the new global standard for AI lifecycle management.
SIG was founded in 2000 and has offices in New York, Copenhagen, Brussels, and Frankfurt, and is headquartered in Amsterdam.

Sigrid®, together with expert consultants, and nearly 25 years of industry-leading research, position Software Improvement Group as the foremost authority on software excellence.

For more information, please visit Software Improvement Group’s website or social media channels.

Experience Sigrid live

Request your demo of the Sigrid® | Software Assurance Platform:
  • This field is for validation purposes and should be left unchanged.

Software Landscape Scan

Uncover inefficiencies and identify risks in your software portfolio. In just 2 weeks.