Using generic CI/CD tools for your IaC automation? đ¤âď¸
We spoke to Don Pinkster, cloud infrastructure lead at Sqills, about how Spacelift takes care of the company’s Terraform automation.Â
Used by leading European transportation operators such as SNCF, Eurostar, SJ, and Renfe, S3 Passenger must be unfailingly available and performant to maintain a consistently efficient service for transport operators. To ensure this reliability and accommodate ongoing and future expansion, Sqills began migrating to the cloud in 2018 and adopted Terraform to manage its cloud infrastructure.Â
At the time, their customer base was much smaller than it is today, so it was easy to automate Terraform using a combination of Bash scripts and Makefiles. As cloud infrastructure lead Don Pinkster recalls, âThis approach served us well for an extended period, but our growth in the last couple of years has revealed its inefficiencies. Right now we have over 40 production customers across the world. Our software is mission-critical for them to operate their business.â
Each new customer means a multitude of new environments for Sqills, making it impractical for a small team to keep everything up-to-date and automated. âKeeping track of 250 plus environments needing updates and identifying those with configuration drift became more challenging, while the cognitive load also increased with the continual expansion of our infrastructure,â explains Don. âThat’s when we started looking into how to automate it more efficiently.â
Sqills started to explore their options for automating Terraform. âWe tried Atlantis, but the integration with Bitbucket Datacenter was not optimal. And Terraform Enterprise did not meet our requirements.â
Sqills came across Spacelift at AWS Summit Berlin in 2022. The platform seemed to be a good fit for the companyâs needs, so they continued the conversation after the summit, getting a demo and starting a free trial. After further investigation, it became clear that they didnât need to look any further: They could manage everything through Terraform with Spacelift. Sqills has a pragmatic approach to adopting new products. As Don explains, âif you try it and itâs good enough, and the price is good â then go for it!âÂ
Audit trails are a big win for Sqills since adopting the Spacelift platform. As a service provider that processes payment card data, Sqills must comply with the Payment Card Industry Data Security Standard (PCI DSS), ISO 9001 and ISO 27001. Given the scale of Sqillsâ customers, âtrying to manage Terraform with Bash and Makefiles just was not good enough. And because we have multiple audits a year for both PCI and ISA, sometimes they ask for the same things, so we can just show screenshots of our Spacelift implementation or screen-share.â
Policies are another feature of Sqillsâ model in terms of enhanced efficiency and control. âWe have some policies in place with Spacelift so that if a pull request is merged and it’s an internal test environment, we apply the Terraform without having to review it. But if itâs a production or acceptance environment, two different people have to approve the pull request.â Spaceliftâs approval policy means they can create sophisticated run review and approval flows in line with their specific workflow, security, and business objectives.Â
Productivity at Sqills has accelerated dramatically. Don explains how adopting Spacelift to automate its Terraform has transformed Sqillsâ lead time to change: âEvery customer of ours is its own installation of S3 Passenger. So we have a lot of environments â currently more than 250 environments. Previously it could take weeks before we actually applied a change on an environment. But now when we make a change, we get notified automatically by Spacelift. And we can say âApply it allâ, for example, because it’s very easy to do instead of checking every environment.â
For Sqills, Spaceliftâs transformative effect boils down to automation. âIf you integrate properly, you don’t use Spacelift that often â because it just works,â explains Don. And that means Sqills can get on with the business of empowering passenger transport operators around the world, confident that they donât have to think about their infrastructure.
âIf a platform like Spacelift didn’t exist, I think we would have developed something ourselves, but if you look at the price point of Spacelift, it’s just not worth the effort for us to do that,â says Don. âI think many years ago we would have built it ourselves because we were quite small, but weâve grown a lot in the last couple of years, so it makes more sense to not always build a thing ourselves â no matter how fun it can be!â
For companies that may be outgrowing their current in-house approach to infrastructure management, Don highlights several areas where the Spacelift platform can help. âSpacelift is really worth it if you initially invest your time in configuring it. If you’re not used to policies, they can be hard to get into â but now Spacelift has a repository with examples of policies.âÂ
He points out that adapting CI/CD tools to manage your infrastructure can work well for smaller organizations â up to a point: âYou can do quite a lot with CI/CD pipelines, but itâs the last steps that are really hard to do and take time and effort. And Spacelift does it for you.â
For organizations without dedicated infrastructure teams, Don believes the visualization Spacelift offers can be particularly helpful. âWe are a dedicated cloud team, so we work with infrastructure 40 hours a week. But if you don’t have these resources available and you spend, let’s say, 20% of your time on infrastructure, and the rest on development, sometimes you just forget what’s there. Then the visualization Spacelift offers can be really useful.â
Ultimately, Sqillsâ automation-first focus allows it to scale its infrastructure as the business demands â while Spacelift minimizes the manual effort required to deliver that infrastructure and embed security and compliance requirements into the delivered services.Â
âWe are used to the fact that Spacelift just works â so we donât use it that much. And thatâs good,â concludes Don.