The Elastic Guru

The Elastic Guru is a community of amazing AWS enthusiasts

We're a place where friendly AWS peeps create, read and share content to ignite the curiosity, learning, growth and success in others.

Create new account Log in
loading...

Discussion on: Gently down the stream with Amazon Kinesis

Collapse
helenanders26 profile image
Helen Anderson Author

I really enjoyed a talk from re:Invent 2019 by the Sony Playstation team who are using streaming technology to evaluate every purchase on their network and prevent fraudulent logins.

The final architecture took the best of batch and streaming processing to reduce time to resolve.

Batch Processing:

  • Batch processing processes all data
  • REST API interacts with Kinesis Firehose to convert to parquet
  • Glue and Spark aggregate data and persists in DynamoDB

Stream Processing:

  • Adds a speed layer for temporary real time current state decisions
  • Uses Kinesis Analytics and persists in DynamoDB

Collapse
lee profile image
lee

Thanks so much for this. Really good stuff 🙏🏽