Note: DLQ for failed lambda invokation stores stream information, not the record itself Solution: You need to call get-shard-iterator, and then
Tag: AWS
AWS EventBridge Pipe to Cloudwatch to Firehose
Cloudwatch logs subscription consumer example code
AWS Kinesis to Eventbridge Pipe to Kinesis
Tutorial: Set up from Console https://www.eliasbrange.dev/posts/debug-dynamodb-with-eventbridge-pipes-and-cloudwatch/ Sample in pipe: { “kinesisSchemaVersion”: “1.0”, “partitionKey”: “1”, “sequenceNumber”: “49590338271490256608559692538361571095921575989136588898”, “data”: “SGVsbG8sIHRoaXMgaXMgYSB0ZXN0Lg==”, “approximateArrivalTimestamp”: 1545084650.987,
AWS Firehose to Elastic Search
How many shards are needed in a new elastic search domain Kinesis firehose destination to elastic search Firehose delivers to
AWS Event Bridge Pipe Filtering
Kinesis to Kinesis Overview code example Data filtering example Filtering kinesis json example Event Bridge Pipe sources Event Bridge Pipe
AWS Credential in Nodejs File
Adding via Shared File Credential, specifying profile name: Shared File Credentials: [default] ; default profile aws_access_key_id = aws_secret_access_key = [personal-account]
Running DynamoDB Locally Offline
https://dynobase.dev/run-dynamodb-locally/
Step Function and lambda
Avoid reaching history quota Tutorial for creating lambda and step function that invokes it Invoke syntax, parameter and payload Supported
S3 Sending Notification to SQS
Example Link Add notification configuration to s3 bucket S3 must depend on notification destination queue policy Allow s3 on queue
Research into s3 read object
AWS list object with pagination AWS CLI examples AWS selectObjectContent with nodejs GitHub example code for selectObjectContent read json with