Flavius is a passionate Developer Advocate with an Infrastructure as Code mindset and expertise in DevOps & Cloud Engineering.

All posts by Flavius Dinu - DevOps Expert

Flavius Dinu

Author title

Title category

Get all the latest content on Infrastructure as Code, DevOps, Spacelift features & news directly to your inbox!

Level up your IaC knowledge. Stay up to date with educational devops guides & news in infrastructure as code, cloud & more!

Managing Infrastructure at Scale | Spacelift Blog

AWS: Spacelift Reduces Time Spent on Cloud Management by 90% 🚀

applepodcasts

spotify

missionctrl

Welcome to missionCTRL, a show dedicated to exploring the frontiers of modern DevOps. Listen (or watch) as we sit down with the practitioners who are pushing the boundaries of development

InfraCost - How to Estimate Cloud Cost with Terraform

Want to level up your Terraform knowledge? Explore our tutorials and step-by-step guides written by Terraform experts. Learn Terraform best practices and solutions to the most difficult problems.

Terraform Guides and Tutorials | Spacelift Blog

Terraform

In the Infrastructure as Code world, estimating costs can be a nightmare for many enterprises. I’ve seen many companies doing extensive research between Cloud Vendors to find out which has the better prices and also to see what their bills would look like at the end of the month.
This process is very time consuming, so there was a need for change. With Terraform, you can easily estimate cloud costs by leveraging Infracost, and you can easily compare potential bills between different vendors.
<a href="https://www.infracost.io/" target="_blank" rel="nofollow noopener">Infracost</a>, as they state on their website, makes you love your cloud bill. With Infracost, you can easily see cost estimates for your resources and enable the engineering teams that are provisioning infrastructure to better understand their changes from a business perspective. 
At the moment of writing this post, Infracost supports AWS, Azure, and GCP and works only with Terraform, but soon they are going to release the integration with CloudFormation and Pulumi. Check <a href="https://www.infracost.io/products/" target="_blank" rel="nofollow noopener">here</a> to see the status of this.

Depending on your operating system, there are a couple of ways you can <a href="https://www.infracost.io/docs/" target="_blank" rel="nofollow noopener">install Infracost</a>. 
To do it on macOS you can simply:

After installing it, make sure it works by checking the version of it:

In order to use it, you will need to register for a free API key. To do that, you will simply have to run:

You can either signup using GitHub or Google, and after that you can retrieve your API key.
To be able to run Infracost locally, you will need to save the API key in an environment variable:

Now you are good to go, and you can use Infracost to break down any charges you will have.
Before jumping in and discussing in detail some use cases, did I tell you there is a <a href="https://marketplace.visualstudio.com/items?itemName=Infracost.infracost" target="_blank" rel="nofollow noopener">VS Code Extension</a> available for it? Well, there is, and with it, you can see a cost estimate while you are writing the code, so that really is a game changer.
Of course, this really helps engineers, but there are also other people involved when making a decision when it comes to costs, so we will see how we can have an overview about this soon.

Let’s suppose you have the following Terraform code that creates multiple ec2 instances:

Nothing too fancy. We are just creating two AWS ec2 instances. Let’s see what the cost will look like for them. To do that, we must first go to the directory that holds our configuration files and run the following command:

If we modify the local variable instances, add another one and re-run the command, the cost change will be reflected:

To better understand how this works, InfraCost verifies Terraform’s current configuration through a <a href="https://spacelift.io/blog/terraform-plan" target="_blank" rel="noopener">Terraform Plan</a> and compares it to the current <a href="https://spacelift.io/blog/terraform-state" target="_blank" rel="noopener">Terraform State</a>. But what it can also do is verify the Terraform Plan and Terraform State and compare them to an older Infracost configuration breakdown that you can save to a file. 
In this way, you will be able to see the cost difference between what is going to be deployed right now and what you had in the past. 
To export the Infracost JSON file from an older configuration, you will simply need to use the above command but with two other arguments:

Let’s suppose, as in the above example, that we’ve generated a file called old_config.json from the first configuration with two ec2 instances. To compare it to the current configuration we would run:

As you can see, due to the fact that we’ve added another ec2 instance, Infracost is capturing that change from Terraform and you see a cost in the monthly increase.

<ul>
<li><a href="https://spacelift.io/blog/terraform-automation" target="_blank" rel="noopener">How to Automate Terraform Deployments and Infrastructure Provisioning</a></li>
<li><a href="https://spacelift.io/blog/how-specialized-solution-can-improve-your-iac" target="_blank" rel="noopener">How to Improve Your Infrastructure as Code using Terraform</a></li>
<li><a href="https://spacelift.io/blog/github-actions-terraform" target="_blank" rel="noopener"><span data-sheets-value="{&quot;1&quot;:2,&quot;2&quot;:&quot;Managing Terraform at Scale with GitHub Actions&quot;}" data-sheets-userformat="{&quot;2&quot;:513,&quot;3&quot;:{&quot;1&quot;:0},&quot;12&quot;:0}">Managing Terraform at Scale with GitHub Actions</a></li>
</ul>

When it comes to managing Terraform and achieving true GitOps around it, Spacelift comes into the picture. Apart from doing GitOps deployments with Terraform, Spacelift enables you to:
<ul>
<li style="font-weight: 400;" aria-level="1">Integrate natively with AWS, Azure, and GCP;</li>
<li style="font-weight: 400;" aria-level="1">Easily do policy as code to manage different levels of access;</li>
<li style="font-weight: 400;" aria-level="1">Run different scripts before or after Terraform operations;</li>
<li style="font-weight: 400;" aria-level="1">Host your own worker pools;</li>
<li style="font-weight: 400;" aria-level="1">Share variables through contexts;</li>
<li style="font-weight: 400;" aria-level="1">Detect drifts in your infrastructure;</li>
</ul>
There are other features available, and what’s even better is that you can <a href="https://spacelift.io/free-trial" target="_blank" rel="noopener">test all of these for </a><a href="https://spacelift.io/free-trial" target="_blank" rel="noopener">free</a>, and you are good to go.
Enabling <a href="https://docs.spacelift.io/vendors/terraform/infracost.html" target="_blank" rel="noopener">Infracost</a> as part of your Spacelift <a href="https://docs.spacelift.io/concepts/stack/" target="_blank" rel="noopener">stacks</a> is way easier than installing it locally because the only thing you have to do is to add an infracost label to your stack.

spacelift-infracost-label

spacelift infracost label

After making sure, you’ve added the infracost label, on the create stack tab, you will simply have to select your repository and you can accept all defaults. 
Moving forward, we will need to provide the API key to the stack as an environment variable. Here comes the good part though, Spacelift has <a href="https://docs.spacelift.io/concepts/configuration/context.html" target="_blank" rel="noopener">contexts</a> and in a context, you can add <a href="https://docs.spacelift.io/concepts/configuration/environment.html#environment-variables" target="_blank" rel="noopener">environment variables</a>. This means that you can easily attach the infracost context to all stacks for which you want to monitor your Infracost without much hassle.
Let’s see how we can do that for better reusability.
First, go to contexts and select “Add context”. Add a name for your context and click “Create new context” as in the screenshot below.

spacelift-infracost-create-new-context

spacelift infracost Create new context

After you are done with this, you can go to your newly created context and add the environment variable like below:

spacelift-infracost-add-the-environment-variable

spacelift infracost add the environment variable

Return to your stack, go to Settings→Contexts and attach the newly created context to it:

spacelift-infracost-contexts

spacelift infracost Contexts

Now, whenever you make a PR or push your code to the tracked branch, you will see directly in the VCS provider the estimated cost done by Infracost. You don’t have to worry about configuring anything else.
For GitHub, for example, if you go to the repository configured for the stack, you will see in the right-hand bottom corner what Environments are configured. Due to the fact that you’ve established the integration with Infracost, you will see it there.

spacelift-infracost-github

spacelift infracost github

In addition to this, you will see the latest runs that happened end to end. You can view all the runs by easily clicking on the green tick if the latest run was successful, the red x if the latest run failed, or the orange dot if the latest deploy is in progress.

spacelift-infracost-github-latest-runs

spacelift infracost github latest runs

By selecting one of the runs, you will see something similar to this:

spacelift-infracost-github-one-of-the-runs

spacelift infracost github one of the runs

Of course, I wouldn’t recommend going in and pushing the code directly into the main/master branch, but if you want to do something for demo purposes that doesn’t take any git flow into consideration, you can easily do so, as I’ve shown you above. 
Let’s follow the correct process and do a PR. For this PR, I will remove one of the ec2 instances.

spacelift-infracost-pr

spacelift infracost pr

In the PR, you are going to see all the checks that are done and in our case it is just the infracost one. By clicking on the details button, you are going to see an estimate similar to the one we’ve seen before.

Spacelift integrates with OPA, and you can define multiple types of <a href="https://docs.spacelift.io/concepts/policy/index.html" target="_blank" rel="noopener">policies</a>. One type is plan policy, and we can leverage this type of policy to integrate with InfraCost. More details about this can be found <a href="https://docs.spacelift.io/vendors/terraform/infracost" target="_blank" rel="noopener">here</a>.
For demo purposes, let’s build a policy that doesn’t permit any hourly cost that is greater than $0.01 per stack resources.
To do that, we have to go to our Spacelift account, select policies from the left-hand side, and add policy.

spacelift-policy

spacelift policy

In the policy, we are going to add the following code:

Add a name to your policy, I’ve added hourly_cost, but it can be whatever you want. After this, we have to attach the policy to our stack. 
To do that, we will go to our Stack → Settings → Policies and attach the newly created policy similar to this:

spacelift-infracost-policies

spacelift infracost policies

Now let’s simply trigger a run on the stack with the remaining two instances. After the plan finishes, if the hourly cost is greater than $0.01, you won’t be allowed to run your code.

spacelift-infracost-history

spacelift infracost history

And that’s the case. The hourly cost is $0.07, so that’s greater than $0.01. You will not be allowed to continue deploying your code.
Of course, in a real-world scenario, you are most likely going to build monthly costs, but to do that, the only code changes per se that you will need to do to your policy is to modify all mentions to hourly_cost variable and put a more suggestive name for your use case (monthly_cost for example) and change the last argument of this variable assignment from totalHourlyCost to totalMonthlyCost.
Having Infracost as part of your IaC process and seeing the details in both Spacelift and in the VCS PR will end up saving costs due to the fact that it will make everybody more aware of the impact of their changes.

You can even add InfraCost as part of pre-commit. With pre-commit you can define some hooks that you can easily run before you are pushing your code. There are multiple ways to install pre-commit, and you can find examples <a href="https://pre-commit.com/" target="_blank" rel="nofollow noopener">here</a>. 
To leverage it, you will need to save your configuration in a file called .pre-commit-config.yaml.

In the above example, I’m using six hooks in order to make sure my code is linted properly, valid and also to get an Infracost breakdown. You may need to install some of these hooks separately before being able to use them in pre-commit.
In the above example, apart from Infracost, which we’ve already installed, there is also a need to install terraform_tflint. Instructions on how to do that are available <a href="https://github.com/terraform-linters/tflint" target="_blank" rel="nofollow noopener">here</a>.
After defining this file, we can run pre-commit with the following:

This is the output you are going to see for the code with two ec2 instances:

By making a habit of running pre-commit before you push your code, you can easily make sure that everything is working as expected and by having an overview of the cost you will be more thoughtful before pushing the code.

Overall, InfraCost really is a powerful tool that can help organizations get a better understanding of what their money is spent on. Multi-Cloud support, detailed cost breakdown, the ability to easily see cost differences between iterations, and the fact that it can integrate with other products, makes it a key player in the Infrastructure as Code world. 
<a href="https://docs.spacelift.io/vendors/terraform/infracost.html" target="_blank" rel="noopener">The integration with Spacelift</a> works natively, and the only thing you have to do to enable it is to just add a label to your stack. Controlling how much you spend via policies is another feature that works really well in this integration. 
It is really important to note the fact that InfraCost is not a silver bullet, you can use it as a guide, but it’s not a substitute for a good governance of your resources.

<span data-sheets-value="{&quot;1&quot;:2,&quot;2&quot;:&quot;Build more complex workflows based on Terraform using policy as code, programmatic configuration, context sharing, drift detection, resource visualization and many more.&quot;}" data-sheets-userformat="{&quot;2&quot;:769,&quot;3&quot;:{&quot;1&quot;:0},&quot;11&quot;:4,&quot;12&quot;:0}">Build more complex workflows based on Terraform using policy as code, programmatic configuration, context sharing, drift detection, resource visualization and many more.

Monitoring Your Spacelift Account via Prometheus

How to Deploy your Infrastructure in CI/CD using Terraform

Introducing Spacelift Cloud Integrations

With Terraform, you can easily estimate cloud costs by leveraging Infracost. Take a look at the Infracost integration with Spacelift.

Flavius Dinu

InfraCost – How to Estimate Cloud Cost with Terraform

Get the newsletter

No recent posts