We’re pleased to share this guest blog “Implementing Feature Flags in Serverless Environments” by Mike Atkins, Software Engineer at LaunchDarkly.
A Demonstration of LaunchDarkly Feature Flags in Serverless with AWS Lambda
Serverless architecture, while a relatively new pattern in the software world, is quickly becoming a valuable asset in a variety of use cases.
There are some notable business advantages to serverless architecture:
- Faster development – easily harness existing backend services and third party APIs to quickly build and deploy apps
- Lower cost – substantially decreased operational costs by not having to manage infrastructure in addition to the componentization of the entire application (only scale what you need to scale)
- Less maintenance – scaling, load balancing, and patches are a thing of the past, serverless platforms take care of it all for us
Coupled with feature flags, a serverless application allows teams to control feature releases without having to redeploy. This is especially useful for serverless applications that tend not to focus on persistence and be more stateless in nature.
In this article, we’ll start with the assertion that you have already decided that serverless functions makes the most sense for your application architecture. What you really need is the ability to continue using feature flags in this type of architecture. This is where LaunchDarkly has got you covered.
We’re going to look at how to integrate LaunchDarkly into an application running on AWS Lambda. AWS Lambda lets you run code without provisioning or managing servers. On the other hand, LaunchDarkly is a feature flag management platform that allows you to easily create and manage feature flags at scale.
For smaller workloads, you can use the LaunchDarkly SDK as you normally would. Evaluating a feature flag with the nodejs runtime in AWS Lambda looks like this:
This naïve approach is appropriate for serverless workloads that have limited concurrency (e.g., a scheduled job). If you have a workload that has high levels of concurrency or sensitivity to cold starts, this approach will have poor cold start performance because we need to call out to LaunchDarkly whenever a new Execution Context is created. To overcome this, we need to add a second Lambda function, an API Gateway, and ElastiCache to build a serverless flag storage pipeline. We’ll use this pipeline to maintain a store of feature flag configurations so that the application can just get flags from redis and avoid a more costly cold start.
Storing Flag Configurations
We’ve gotten some great feedback that has pointed out that by using ElastiCache, we’re hurting the cold start time. In order to use ElastiCache, you must put your Lambda function in the same VPC as the cache. This causes an ENI to be created on cold starts, which can actually be slower than calling LaunchDarkly. We’re working on an alternative using DynamoDB. The methodology below is still useful if you want to isolate your lambda functions from LaunchDarkly.
AWS turns out to be a well-equipped platform for feature flags in serverless. In our implementation, we create a webhook in LaunchDarkly to hit an API Gateway endpoint which acts as a trigger for invoking a lambda function.
Then, the lambda function can have LaunchDarkly populate a Redis ElastiCache cluster by initializing its SDK with the built-in “RedisFeatureStore” option. This lambda function built on the NodeJS runtime would look something like this:
Note that we’re initializing the LaunchDarkly SDK inside the handler. That’s because, by initializing the SDK, we’ll pass the update that triggered the webhook along to the redis store.
Processing Feature Flags
Now that our flag configurations are neatly stored in the Elasticache cluster, we need to change our naïve Lambda function to retrieve and process flags without waiting for any outbound connections to LD! This is achieved by enabling LaunchDarkly Relay mode in the SDK options. The function’s “event” parameter can be used to pass in a user to be evaluated by the LaunchDarkly SDK.
It’s important to understand that there are multiple ways to implement feature flags in your serverless architecture. The method will depend on your app’s structure, your serverless provider, and your implementation timeline. You can check out this guide to feature flagging for best practices and ways to get started.
Visit the LaunchDarkly Blog for more on feature flag management.