Kinesis

What is streaming data?

• Data that is generated continuously by thousands of data sources, which typically send in the data records simultaneously, and in small sizes (order of Kilobytes)
  • Purchases from online stores (amazon.com)
  • Stock prices
  • Gate data (as the gamer plays)
  • Social Network Data
  • Geospatial data (uber.com)
  • IOT sensor data

What is Kinesis?

• AWS platform to send streaming data to. Kent’s is makes it easy to load and analyze streaming data, and also provide the ability for you to build your own custom applications for your business needs.

Core Kinesis Services

• Kinesis Streams
  • Consist of Shards
    • 5 transactions per second for reads, up to a max total data read rate of 2 MB per second and up to 1000 records per second for writes, up to a maximum total data write rate of 1 MB per second (including partition keys)
    • The data capacity of your stream is a function of the number of shards that you specify for the stream. The total capacity of the stream is the capacities of its shards.
• Producers > shard > ec2
  • Stored by default for 24 hours - up to 7 days retention
  • Stored sharded
• Kinesis Firehose
  • Producers > Firehose > S3, Redshift, or ElasticSearch
  • No shards
• Kinesis Analytics
  • Producers > SQL Query > S3, Redshift, or ElasticSearch

Exam Tips

• Know the difference between Kinesis Streams and Kinesis Firehose. You will be given scenario questions and you must choose the most relevant service.
• Understand what Kinesis Analytics is.