I am working on use case where I need to transfer data from multiple DynamoDB tales to single S3 bucket in an event based manner. The design I had can support data from one DynamoDB table to s3 and is event based architecture. The design is DynamoDB -> DB stream -> Lambda -> SQS -> Lambda -> firehose -> S3. I'll have to transform data in between hence the lambda from SQS to firehose.
Can I use this single pipeline to send data from multiple DynamoDB to single s3 or would have to create multiple same pipeline for each table?if I can optimize the current design?