🐏 mogoz

Search

SearchSearch

AWS

Jun 30, 2024, 27 min read

tags : Infrastructure, Containers, Kubernetes, Terraform

FAQ

EBS what?

  • EBS can be confusing
  • Elastic Beanstalk (EB)
  • Elastic Block Storage (EBS)
  • Proper use is EB and EBS

Security services in AWS?

See Cloud cryptography demystified: Amazon Web Services | Trail of Bits Blog

Deploying containers on AWS

  • See Containers on AWS
  • See 17 More Ways to Run Containers on AWS
  • See Concurrency Compared: Lambda, App Runner, AWS Fargate
  • K8s on EC2 / EKS: Extremely robust, scalable, and need tight controls over your containers.
  • Docker Swarm on EC2: Simple orchestration but still want to manage it.
  • ECS on EC2: Ease of use and want access to your hosts
  • ECS on Fargate: Never think about anything other than the container
  • Plain EC2 with docker/docker-compose: This is where you manually install docker and docker-compose on EC2. You can do this but I’d prefer using ECS with EC2 instead.
  • EC2+Beanstalk+Docker: Can be done but pretty cumbersome.
  • docker on lightsail
  • lightsail container service
  • Apprunner

Managed services?

Spot Instances?

This allows running fault-tolerant workloads at a much cheaper price

  • EC2 Spot instances
  • Fargate Spot instances

Things that cost you vs things that don’t

ThingCosts?Description
IGWNO
Cross AZ NAT trafficYes
Cross AZ load balancing(ALB)NO
Cross AZ load balancing(NLB)Yes
Accessing public ALB from private subnet via NATYes
Accessing NAT gateway from different AZYes

Concepts

AMI

  • Amazon Machine Image
  • pre-configured virtual machine image, used to create and launch instances within Amazon Elastic Compute Cloud (EC2).

Roles & Accounts & Users

IAM Roles

  • ARN

More notes on IAM

  • On Roles in general

    • When creating iam role, we need to specify two policies
      • Trust policy: This usually includes sts:AssumeRole and the Principal (who can use this role)
      • identity policy: These are the permissions that the role gets to access different AWS resources, eg. Access to S3, access to secrets manager etc.

  • On roles for application workloads

    • Ideally dev environment and prod environment would be in two separate aws accounts in the same organization. (Preferably organized per OU, we have one OU we just have one product in houseware), in those cases we would have different dev-workload-role and prod-workload-role as iam role is account specific.
    • In our case, we’re not practicing multi-account setup. Our dev env and prod env are in the same aws account but in different regions. In this case having separate roles for dev and prod does not make much sense. So instead, we use the same role for managing workload for dev and prod. We just add all of the resources(dev and prod) combined into the resource identity policy.
    • The workload roles themselves may be shared among different workloads if they need similar permissions, else certain workload may have very specific policy for its role that it solely uses.
      • Eg. Policy X grants s3 access. Policy X is applied to Role WorkloadRole1
      • Now workloads W1 & W2 need s3 access, they can assume the role WorkloadRole1 (share)
      • W3 is another workload, it has different aws resource requirements, it’ll probably need creation of a new specific policy and role.

  • On roles for our human users (IAM Identity Center)

    • Currently we’re using IAM users/IAM user groups instead of IAM Identity center users
    • It’ll be super convenient to use IAM Identity center instead for user management and delegating access etc.
    • But for now having managed policies + user group seems like a sane approach till we totally move to using Identity center
    • Identity center has several benefits
      • If at some later point in time we do multi account aws setup for different deployment environments, since IAM users are account specific, they’ll have to login differently into each account. But If you use Identity center users, on top of user management being easier, the created user would have cross account access given they have the valid permissions.

Networking in AWS

AZ

Regions vs Availability Zones

  • Region: us-east-1, us-east-2
  • AZ: us-east-1a, us-east-1b

AZ and Subnets

  • 1:N relation (1(AZ):N(subnets))
  • Each subnet must reside entirely within one Availability Zone and cannot span zones.
  • Each AZ can have many subnets(public/private)

IP address assigning

  • IP addressing for your VPCs and subnets - Amazon Virtual Private Cloud
  • Everything has a private IP, when there’s a public IP for something. The public IP is mapped to the private IP of that instance.
  • Can happen at a VPC level (??)
  • Can happen at the subnet level
    • This is what is confused me. Having this setting enabled doesn’t make a subnet public. There’s a different definion of a public subnet
  • Can happen at the instance level
  • Also can be assigned via ElasticIP

Subnets

Subnets in AWS(Cloud) vs Classical subnets

While the idea of subnet is the same but the reason why we create subnets in classical Networking and in AWS/cloud are different

  • In on-prem, we use subnet gateways typically to perform filtering, broadcast traffic and fault isolation etc. (L2 involved)
  • In could, there’s no L2. In AWS, each subnet can route to other subnets within the VPC range(s). We can filter using NACL and SG.
  • Usecase in cloud of subnet are possibly the following
    • Routing: If we need to separate traffic of IGW vs NGW vs VGW vs TGW etc. we need subnets as subnets will result in route tables
    • HA: In AWS, subnets are related to AZ
    • Traffic Filtering: If you want to use NACL, you’d need to create subnets

TODO Routing tables

  • See Configure route tables to understand route-tables.
  • There are different levels of route-tables
  • Subnets have route table (Private and Public subnets have their own route table)
  • Inter subnet communications
    • Routing between subnets is handled internally within the VPC based on the routes defined in the associated route tables.

VPC

See Practical VPC Design (Also has notes about Security Groups)

  • By default, when you create a VPC, a main route table is created.
  • Amazon VPC quotas

Subnets

  • Subnets and AZ

    • Subnets exist in exactly one AZ
    • CIDRs for each subnet in a VPC cannot overlap

  • Public and Private

    • Public

      • A subnet with the default route to the IGW
      • IP assign
        • Configure VPC to assign public addresses to instances
        • Assign Elastic IP addresses to instances

    • Private

      • A subnet with NO default route to the IGW
      • Instances in private subnet can’t communicate with the internet over the IGW
      • Since instances in the private subnet will have private IPs, and IGW does not do NAT for private IPs, we just cannot do outbount/inbound. (But this is not the case w IPv6)

      • Internet access for instances in private subnet

        • NAT instance/gateway in a public subnet
        • 0.0.0.0/0 in private subnet points to the NAT Gateway
        • NAT gateway points to IGW

Default vs New VPC

  • Default VPC has functional advantage
  • A default VPC comes with a public subnet in each Availability Zone, an internet gateway, and settings to enable DNS resolution.

VPC and Gateways

  • AWS Gateways are things that are related to a VPC, not to subnets
  • VPC is just a LAN with local access until you stick an IGW on it.
    • i.e a routing table entry allowing a subnet to access the IGW.
  • Whether or not traffic uses IGW or NGW depends on subnet’s routing
    • e.g. an instance w public EIP can go directly out the IGW
    • e.g if we route 0.0.0.0/0 to the NAT GW for that instance’s subnet, it would get NAT’ed to the NATGW.

DNS inside VPC

  • Amazon DNS server
  • VPC Peering is linking a VPC and is CIDR range to another so you need to be careful of ensuring different CIDR ranges.
  • VPC Endpoints are a way of connecting to managed services, without going to the public internet and back again.
    • Usually you’d use AWS PrivateLink to implement VPC endpoints
    • AWS PrivateLink is technology allowing you to privately (without Internet) access services in VPCs. These services can be your own, or provided by AWS.

Gateway

Internet gateway (IGW, Twoway, Inbount&Outbound)

  • Internet gateway routes public IPs IN/OUT->TO THE INTERNET
  • Does not do NAT for private subnets, for public subnet
    • Logically provides the one-to-one NAT on behalf of your instance
    • When traffic goes VPC to Internet, reply address is set to the public IPv4 address or EIP of instance
    • When traffic comes Internet to EIP/PublicIPv4, destination address translated into the instance’s private IPv4 address before the traffic is delivered to the VPC.
  • Two Way
    • Allows resources within your public subnet to access the internet
    • Allows the internet to access said resources in the public subnet.

NAT gateway (NGW, Oneway, Outbound)

  • See NAT
  • Translates private IPs to it’s public IP.
  • You cannot associate a security group with a NAT gateway. You can associate security groups with your instances to control inbound and outbound traffic.
  • A NAT gateway has to be defined in a public subnet
    • Public NAT gateway is associated with One Elastic IP address which cannot be disassociated after its creation.
  • A nat gateway still uses IGW to get to the Internet.
  • One way
    • private resources access the internet

  • Usecases

    • Instances in private subnets talking to the internet
    • Whitelisting IP: Making all outgoing traffic through a NAT Gateway(single IP) is useful when whitelisting IP addresses with external services. For this reason, it’s useful to have a EIP for NAT Gateway, Eg. If you ever need to replace your NAT instance, you don’t need to update the whitelist in other places because now you have a EIP :)

  • NAT gateway vs NAT instance

    • See Compare NAT gateways and NAT instances
    • See https://fck-nat.dev/stable/deploying/
    • They both perform the same action
    • NAT instance is like EC2, no HA, Cheaper and tough to scale.
      • You run NAT software on an EC2 and managing it.
    • NAT gateway is HA plus scalable, hence costly. It’s a managed AWS service. You can’t SSH to NAT gateway and it’s very stable.
    • So in a way, NAT instance is self managed NAT gateway

  • Other notes

    • Cross AZ is expensive
    • So we want a NAT gateway per AZ, i.e per subnet i.e per public subnet
    • If anything that always needs public internet access to operate, it’ll be probably be cheaper to put it in a public subnet with appropriate SG rules.

IPv6

Concepts/Services

  • Dual stack

    • Dual stack VPC

      If it has CIDR blocks for IPv4 and IPv6

      • IPv6 CIDR Block

        • Can be dual stack or IPv4 only

      • IPv6 Routing

        • VPC has routing table, subnets can talk to each other

      • DNS

        • Each VPC has its own DNS resolver(route53 resolver), tied to the region’s Route53
        • DNS resolver has both IPv4&IPv6 addresses
        • Each EC2 instance can send 1024 packets per second per network interface to Route 53 Resolver (.2 address)

      • Subnet Types and traffic flow

        • Dual stack (Eg. migrating existing subnet to IPv6)
        • IPv4 only (Eg. existing subnet)
        • IPv6 only
        • All of these subnet types can co-exist in a VPC

        • How will a IPv6 only EC2 instance talk to a IPv4 subnet?

          • Do we run IPv4 & IPv6 in parallel? Backwards compatibility
    • Dual stack ELB

  • IP management

    • Hierarchy and Organization

      We want things like easy summarization and good structure and hierarchy in our subnets.

      • Example CIDR hierarchy: Top level pool > regions > routing domains/environments > VPCs > Subnets
      • AWS by default assigns us a random CIDR for IPv6. (From the Amazon pool). Instead we create our own pool so that we can manage things ourselves
        • Eg. For each region I am going to assign this CIDR block and then from that block I’ll start allocating CIDRs to the VPCs.

    • IPAM

      IPAM allows you to manage IP address across multiple accounts/regions

  • IPv6 IP assigning

    • /56 : For VPC (Fixed length) (Number of vpc is limited, 5 non-overlapping VPC ranges.)
    • /64 : For Subnets inside the VPC (Fixed length) (Number of subnet is limited)
      • Network identifier and host identifier can be 64bit each

  • Internet Connectivity

    • IPv6 to IPv6

      • IPv6 addresses with the EC2 instance in a public subnet in a VPC would be a global unicast address.
      • So we would not need NAT there, It can directly talk throught the IGW.

    • IPv6 in a Private subnet

      • The IPv6 address is globally unicast
      • So if we put a instance which is in a subnet(which we consider private) but has a set the gateway to the internet gateway, we’re exposing it bi-directonal to the internet.
      • Because unlike IPv4 private networks they can just use the internet without NAT.
      • Solution is to use egress only IGW

Usecases

  • Network

    • Aquition: oVerlapping ipv4 addresses!
      • Solution
        • Dual stack VPC & IPv6 only subnets
        • Dual stack internal network routing
          • We have VPC2VPC methods that allow us to access internal ipv6 network
          • VPC2VPC
            • AWS Transist Gateway
            • Cloud1
            • Hybrid connectivity w VPN
            • Direct connect

  • Services & Businesses

    • Exposing services on
      • On AWS network
      • On Public internet
    • Now the business wants to serve clients who are connecting to it using ipv6 (In places w greater ipv6 adoption)
      • Dual stack VPC (Network level) + Dual stack ELB (Service level)

Operations

Load Balancers

AWS offerings

  • ELB / CLB (Not recommended)

  • ALB (L7)

    • Primary purpose of alb is to split traffic for the same route between different backends.
    • Also rule based routing. (AWS API Gateway(AGW) only does this)
  • NLB (L4)

reverse proxies vs Load Balancers?

Options are either of:

  • NLB + nginx/traefik/caddy etc
  • ALB + LB controller(if using Kubernetes)

Additionally:

Target Groups

  • Registering & Deregistering

    • When registering, ensure that you have appropriate security groups that allow LB-instance inbound communication.
    • When deregister a target, the load balancer waits until in-flight requests have completed.

  • Targets types

    This can be different for different kind of LB

    • instance-id (picks ip-address from the instance)
      • ASG(AutoScalingGroup): This helps with the fact that you no longer now need to manually add/remove targets from the TargetGroup as application load increases/decreases. This happens via Amazon EC2 Auto Scaling, it automates that manual add/remove of instances from the target group by selecting an exiting LB and exiting TG
    • ip (from valid CIDR block)
    • lambda

  • Mapping

    • N:N mapping, N(TG):N(Targets)
      • There can be multiple TG
      • A target can be associated with multiple TG
    • 1:N mapping, 1(LB):N(TG)
      • Each TG can be used with only one LB
      • One LB can have multiple target groups

ALB

Troubleshoot/Info?

What is an ALB really?

  • 2 things. The definition of the LB(LB object) and the actual provisioned instances per AZ.
  • As an AWS user, you only ever directly deal with the LB object(configuring etc).
  • Based on your configuration, it provisions the LB instances in respective AZ which do the actual load balancing.
    • ALB instances serve targets in its AZ, or in cross-AZ/cross-VPC as-well if targets are there.
  • AZ and TG for an LB need to be in same VPC

Process of ALB creation

  • LB object => LB instances in AZ => LB instances in subnet => IP address assigned
  • DNS for both internal and ALB is publicly resolvable. Useful when you connect via VPN.
  • Both internet-facing and internal load balancers route requests to your targets using private IP addresses. Therefore, targets don’t need public IP to receive requests from an internal/internet-facing LB.

  • Internet facing ALB

    • You define the LB object. (Two AZ)
    • Since internet-facing, subnet that the AZ belong to will be public (route to IGW)
    • It’ll provision LB instance in the two AZ
    • Create EIP with a public IP. This IP can keep changing so refer to ALB by DNS name.

  • Internal ALB

    • You define the LB object. (Two AZ)
    • Since internal, subnet that the AZ belong to will be private (no IGW)
    • It’ll provision LB instance in the two AZ
    • A private IP will be assigned to the LB instance.

Placing an LB in a subnet and LB talking to targets

  • You enable a AZ for a LB by placing the LB in that AZ, i.e placing the LB in one of the subnets of the AZ
  • Once it’s placed in a subnet in an AZ, by virtue of VPC route tables, it’ll be able to talk to all private/public subnets wherever the targets are.

What about capturing real client IP?

See Capture client IP addresses in the web server logs behind an ELB & HTTP

How does ALB talk to clients(users) and targets?

  • See How ELB works doc
  • Could use multiple HTTP based protocols for client communication, uses HTTP1.1 for target communcation
  • Both internet-facing and internal LB route requests to targets using private IP addresses

Usecase of internal ALB?

Usecase of external ALB is apparent, but folliwing are some usecases for internal ALB

  • Multi tier
    • internet-facing LB <-> Web-server(s)
    • internal LB <-> Application-server(s)
    • Final: internet-facing LB <-> Web-server(s) <-> internal LB <-> Application-server(s)
    • The web-server(s) can be looking up a DNS record which would point to the internal LB and then it can use Host headers etc.
  • Giving access to internal services in a VPC
    • Suppose you want to host grafana/some other internal service in the VPC
    • People can use some kind of VPN to access the VPC
    • The internal LB can be handy here trying to give access to the various internal services to people using the VPN
  • Service Discovery (See Infrastructure)
    • While AWS offers various ways to do service discovery, having an internal LB can also be a way to do the same.
      • Cloudmap, ECS Service Connect, AppMesh, etc etc.
    • service A -> internal LB -> service B

Connection establishment vs Traffic flow in ALB

  • Connection Establishment

    Following diagrams initially confused me, I confused direction of connection establishment to traffic flow.

Benefits of Cross-AZ load-balancing?

For ALB, two AZ and cross AZ LB must be enabled

Does ALB has to do anything with NAT Gateway?

  • No. Both can operate independently as per need.
  • Usecase of both is different
  • Reply traffic goes though the ALB only, no NAT needed. Check the traffic flow question.

TODO Security in AWS

Certificates

  • ACM certificate by region

SG

  • security groups can be used to control networking access by only allowing inbound traffic from other known security groups that you add to the allow list. (Verify??)

NACL vs Security Groups

If we want defense in depth, we want to be using both

NACLSG
Stateful?Stateless (Return traffic needs to be explicitly allowed)Stateful
RulesBoth allow and DenyAllow only
AssociationSubnets(1:N mapping, 1(NACL):N(subnet))Network Interface, Instance(EC2)

Also see

Storing application secrets

Services

EC2

ECS

  • A Container orchestration tool/layer
  • We can have multiple ECS clusters
  • Alternative: Kubernetes, Docker Swarm
  • Is free, You pay for the underlying host(ec2/fargate)
  • ECS will allow you to deploy a wide variety of containers on a number of instances and automatically handles the complexity of container placement and lifecycle for you. This is useful compared to using docker-compose on your ec2 instance.
  • Handles Services&Task Definitions

Additional notes

  • ECS can integrate with other AWS services like load balancers, but they leave that completely up to you. It’ll just orchestrate your stuff. Unlike EBS it’ll not put a loadbalancer etc for you.
  • Passing runtime configurations for images as it doesn’t have ConfigMaps like Kubernetes

Flavors

  • ECS on EC2
    • EC2 instance need to install the ECS agent/AMI
    • Resources in EC2 might be over-provisioned if the container does not use most of it
    • You can also have it manage ASGs of your own EC2 instances
  • ECS on Fargate

Elastic Beanstalk (EBS)

  • Beanstalk is a Platform as a Service (PaaS) offering
  • Puts the application in a autoscaling group by default?
  • Also will deploy a load-balancer.
  • It spins up a few opinionated services under the covers for you in an attempt to make deploying your application easier. (may not be desirable)
  • It’s like heroku from AWS

Lightsail

See Compare Amazon EC2 and Amazon Lightsail | AWS re:Post

  • Easiest way to run a virtual machine on AWS.
  • Good if you simply want to host simple one-off webapps/custom code etc.
  • Has restrictions on features and capabilities versus ec2.
  • Has a lightsail specific loadbalancer
  • No autoscaling
  • Network
    • Managed by AWS
    • No concept of private subnet
    • w EC2 user gets to configure the VPC.

Lightsail container services

  • This is priced different offering than lightsail instances but falls under the lightsail umbrella.
  • It’s very simplified container deployment, image url and port, that’s all.
  • Under the hood, ECS power lightsail container services.

AppRunner

Cloudfront

CDN

API gateway (AGW)

  • See CORS, alternative could be selfhosting something like Kong
  • API gateway’s primary purpose is rule based routing.
  • Once you get beyond a low number of requests, it becomes a lot more expensive than an ALB,
  • Features
    • Rate Limiting
    • Authorizers
    • B/G Deployments

CDN/Cloudfront infront of API Gateway?

Useful for couple of reasons:

  • Caching: Even if API gateway may have its own caching, could be expensive
  • Clients will connect to the nearest point of contact
  • HTTPS (TLS) negotiations happens in the nearest point reducing latency

ACM (AWS Certificate Manager)

Storage

Storage FAQ

Do all EBS volumes can go with all EC2 instances?

  • No
  • Instances also have certain IOPS limitations, you want to use only those instances that are compitable with the EBS volume you’re planning to wire it up with

IOPS

Voluming naming in EBS and EC2 instances

Multi attach EBS?

  • Not all volume types allow multi-attach

What is a EBS volume really?

A single EBS volume is already made up of multiple physical disks running in an AWS data center. EBS volumes are about 20x more reliable than a traditional disk. If that’s not enough, you can snapshot your EBS volumes to S3, which is designed for 99.999999999% durability. You can create new EBS volumes from these snapshots.

  • reddit user

Elastic Block Storage (EBS) vs Elastic File System (EFS)

We can Can we shrink EBS?

EBS Latency

EBS & Snapshot Cost

  • Snapshots against the same volume are incremental, so there’s not much added cost

EBS (Elastic Block Storage)

What types of volumes do we have? (conceptual, Tactical Knowledge)

Root volume type (for AMI)

  • When we create new instances we can specify the ami, the ami would have a root-volume-type
    • root-volume-type can be: ebs or instance store
    • AWS recommends using ebs bsed ami
    • By default when you use ebs root volume type, it’ll the the snapshot provided by the ami. This is configurable at instance creation time.
  • Root EBS store by default gets deleted if instance is destroyed(not stopped), Data EBS live as is by default even if the attached instance is destroyed. (configurable)

Growing EBS

  • Start small! With EC2 instances, you pay per GB of disk (EBS volume) that you provision - so creating a big disk is a fat waste of $$$
  • You can grow 2 ways

Process of Growing EBS

  • From CLI/Terraform modify the target size/any other modification to the EBS Volume
  • After modifying a volume, you must wait at least six hours and ensure that the volume is in the in-use or available state before you can modify the same volume.
    • volume states: creating, available, in-use, deleting, deleted, and error
    • modification states: modifying, optimizing, and completed
  • After the EBS volume is resized, and is in optimizing or completed state, we:
    • Need to extend the partition
    • Need to extend the filesystem
  • Now here is where having LVM (Logical Volume Manager) in your EC2 instance can help
    • You can use vanilla linux ways to do it
    • Or you can use LVM way of it to do it
      • Expand EBS volume (via tf/cli/console)
      • Grow Partition - growpart
      • Physical Volume Resize - pvresize
      • Logical Volume Resize - lvresize
      • Resize File System - resize2fs

Snapshots

  • A snapshot is a backup of an EBS volume
  • EBS volume is the virtual disk associated with an EC2 instance

How/When to take snapshots?

  • If the EC2 instance does not run a database
    • Snapshots can be taken in a live system
  • If the EC2 instance runs a database
    • Snapshots should be taken only after the instance is stopped
    • i.e You want to take the snapshot in a consistent state

Snapshots vs AMIs

  • AMI is just a metadata wrapper around snapshots
    • Usually you’d want either create AMI or snapshot but not both but this depends on the scenario
  • Summary of the metadata
    • There can be one or more snapshots (root volume, any additional ebs volumes).
    • Launch perms for the ami
    • And block device mappings for the ebs volumes.

Snapshots vs Backups

We do snapshots every night and delete the ones that are older than 35 days. Taking a snapshot is a lot faster depending on what the differential is between the previous snapshots. For example, if there is a 1 TB change in data between from the previous snapshot to then one you’ll be creating, then it may take a while to get created. We’ve seen this a couple of times in our production environment, so it all depends on what’s changing on the volume.

  • Having snapshots is not a sure-shot backup strategy
  • If in any case, snapshots fails, you have another completely unrelated backup method ready to go etc.

Cloudwatch

Period

Period is a query level thing

  • Metrics stored with
    • Standard resolution: Can be retrieved with period of multiple of 60s
    • High resolution: Can be retrieved with period of 1s, 5s, 10s, 30s, multiple of 60s
  • If you try querying standard resolution metric(1m) with a period of 30s, you cannot get granularity at that level. You’ll get the same data as 1m.
  • On the other hand, you can query 1m resolution metrics at higher period like 5m. In the case of a 5 minute period, the single data point is placed at the beginning of the 5 minute time window. In the case of a 1 minute period, the single data point is placed at the 1 minute mark. So the graph for the same looks different.
  • Higher granularity period + higher granularity resolution, Good for
  • Analogy
    • Resolution: photo resolution (Eg. mega pixels)
    • Period: Zoom level on the photo when viewing it
    • Dynamic time period when viewing graph: Panning on the image

Resolution

Resolution TypeGranularity/ResolutionExample
Standard1mAWS service metrics, Custom metrics
High Resolution1s (<60s)Custom metrics
  • Basic monitoring (Ingestion 5m)
  • Detailed monitoring (Ingestion <5m)

Metric Retention & Rollups

ResolutionRetentionNotes
<60s3hhigh-resolution
1m15d
5m63d
1h15mo
  • CW stores data of terminated instances as-well
  • CW metrics have automatic roll up. i.e Data points that are initially published with a shorter period are aggregated together for long-term storage.
    • Eg.
      • We collecting data with 1m resolution
      • Till 15d: 1m resolution, can retrieve with resolution of 1m
      • After 15d: Aggregated, can retrieve only with resolution of 5m
      • After 63d: Aggregated, can retrieve only with resolution of 1h

AWS builder library

DevTools

Graph View

Backlinks