Learn Flink
2018-11-20 本文已影响107人
丹之
A curated list of awesome things related to Apache Flink. Inspired by Awesome Hadoop and Awesome Vue.
Packages
Notebooks
- Apache Zeppelin - Web-based notebook that enables interactive data analytics with plugable backends, integrated plotting, and extensive Flink support out-of-the-box.
Machine Learning
- Flink-TensorFlow - A library for machine intelligence in Apache Flink™, using the TensorFlow library and associated models.
Interfaces
- Apache Beam - Unified data processing engine supporting both batch and streaming applications. Apache Flink is one of the supported execution environments.
Connectors
- Apache Bahir - Collection of the connectors excluded from Flink (Akka, ActiveMQ, Flume, Netty, Redis).
Benchmarks
Resources
Various resources, such as books, websites and articles.
Official Resources
External Resources
Community
Books
- Stream Processing with Apache Flink - by Fabian Hueske, Vasiliki Kalavri (Nov 2017)
- Learning Apache Flink - by Tanmay Deshpande (Feb 2017)
- Introduction to Apache Flink - by Ellen Friedman, Kostas Tzoumas (Oct 2016)
Papers
- Lightweight Asynchronous Snapshots for Distributed Dataflows - Paper proposed Asynchronous Barrier Snapshotting (ABS) implemented in Flink to support stateful stream processing. (Jun 2015)
- Apache Flink™: Stream and Batch Processing in a Single Engine - Paper introducing Apache Flink for processing streaming and batch data under a single execution model. (Jan 2015)
- The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing - Paper introducing the Dataflow model which Flink's streaming model based on. (2015)
- Efficient Pattern Matching over Event Streams - Flink CEP library inspired by this paper. (2008)
Blogs
- Official Flink Blog
- The data Artisans Blog
- Jark's Blog(中文)
- Yanghua's Blog(中文)
- THE MUSINGS OF RAWKINTREVO
Flink Forward
- Flink Forward 2015 - Slides and Videos
- Flink Forward 2016 - Slides and Videos
- Flink Forward San Francisco 2017 - Slides and Videos
Slides
2017
- Timo Walther: Table & SQL API – unified APIs for batch and stream processing Flink Forward San Francisco, April 2017: SlideShare
- Kostas Kloudas: Extending Flink’s Streaming APIs Flink Forward San Francisco, April 2017: SlideShare
- Tzu-Li (Gordon) Tai: Joining the Scurry of Squirrels: Contributing to Apache Flink Flink Forward San Francisco, April 2017: SlideShare
- Stefan Richter: Improvements for large state and recovery in Flink Flink Forward San Francisco, April 2017: SlideShare
- Ufuk Celebi: The Stream Processor as a Database: Building Online Applications directly on Streams Flink Forward San Francisco, April 2017: SlideShare
- Jamie Grier: **Apache Flink - The Latest and Greatest ** Flink Forward San Francisco, April 2017: SlideShare
- Stephan Ewen: Experiences running Flink at Very Large Scale Flink Forward San Francisco, April 2017: SlideShare
- Stephan Ewen: Convergence of real-time analytics and data-driven applications Flink Forward San Francisco, April 2017: SlideShare
- Till Rohrmann: Redesigning Apache Flink’s Distributed Architecture Back to Sessions overview Flink Forward San Francisco, April 2017: SlideShare
- Timo Walther: Table & SQL API - unified APIs for batch and stream processing Apache Flink Meetup Amsterdam, March 2017: SlideShare
- Kostas Kloudas: Extending Flink's Streaming APIs Apache Flink Meetup Berlin, February 2017: SlideShare
- Fabian Hueske: Stream Analytics with SQL on Apache Flink Big Data Tech Summit, Warsaw February 2017: SlideShare
2016
- Stephan Ewen: Stream Processing as a Foundational Paradigm and Apache Flink's Approach to It Big Data, Berlin v 10.0, December 2016: SlideShare
- Kostas Tzoumas & Stephan Ewen: Keynote -The maturing data streaming ecosystem and Apache Flink’s accelerated growth Flink Forward, Berlin September 2016: SlideShare
- Robert Metzger: Connecting Apache Flink to the World - Reviewing the streaming connectors Flink Forward, Berlin September 2016: SlideShare
- Till Rohrmann & Fabian Hueske: Declarative stream processing with StreamSQL and CEP Flink Forward, Berlin September 2016: SlideShare
- Jamie Grier: Robust Stream Processing with Apache Flink Flink Forward, Berlin September 2016: SlideShare
- Jamie Grier: The Stream Processor as a Database- Building Online Applications directly on Streams Flink Forward, Berlin September 2016: SlideShare
- Till Rohramnn: Dynamic Scaling - How Apache Flink adapts to changing workloads Flink Forward, Berlin September 2016: SlideShare
- Stephan Ewen: Running Flink Everywhere Flink Forward, Berlin September 2016: SlideShare
- Stephan Ewen: Scaling Apache Flink to very large State Flink Forward, Berlin September 2016: SlideShare
- Aljoscha Krettek: The Future of Apache Flink Flink Forward, Berlin September 2016: SlideShare
- Fabian Hueske: Taking a look under the hood of Apache Flink's relational APIs Flink Forward, Berlin September 2016: SlideShare
- Kostas Tzoumas: Streaming in the Wild with Apache Flink Hadoop Summit San Jose, June 2016: SlideShare
- Stephan Ewen: The Stream Processor as the Database - Apache Flink Berlin Buzzwords, June 2016: SlideShare
- Till Rohrmann & Fabian Hueske: Streaming Analytics & CEP - Two sides of the same coin? Berlin Buzzwords, June 2016: SlideShare
- Robert Metzger: A Data Streaming Architecture with Apache Flink Berlin Buzzwords, June 2016: SlideShare
- Stephan Ewen: Continuous Processing with Apache Flink Strata + Hadoop World London, May 2016: SlideShare
- Stephan Ewen: Streaming Analytics with Apache Flink 1.0 Flink NYC Flink, May 2016: SlideShare
- Ufuk Celebi: Unified Stream & Batch Processing with Apache Flink. Hadoop Summit Dublin, April 2016: SlideShare
- Kostas Tzoumas: Counting Elements in Streams. Strata San Jose, March 2016: SlideShare
- Jamie Grier: Extending the Yahoo! Streaming Benchmark. Flink Washington DC Meetup, March 2016: SlideShare
- Jamie Grier: Stateful Stream Processing at In-Memory Speed. Flink NYC Meetup, March 2016: SlideShare
- Robert Metzger: Stream Processing with Apache Flink. QCon London, March 2016: SlideShare
- Vasia Kalavri: Batch and Stream Graph Processing with Apache Flink. Flink and Neo4j Meetup Berlin, March 2016: SlideShare
- Maximilian Michels: Stream Processing with Apache Flink. Big Data Technology Summit, February 2016: SlideShare
- Vasia Kalavri: Single-Pass Graph Streaming Analytics with Apache Flink. FOSDEM, January 2016: SlideShare
- Till Rohrmann: Streaming Done Right. FOSDEM, January 2016: SlideShare
2015
- Till Rohrmann: Streaming Data Flow with Apache Flink (October 29th, 2015): SlideShare
- Stephan Ewen: Flink-0.10 (October 28th, 2015): SlideShare
- Robert Metzger: Architecture of Flink's Streaming Runtime (ApacheCon, September 29th, 2015): SlideShare
- Robert Metzger: Click-Through Example for Flink's KafkaConsumer Checkpointing (September, 2015): SlideShare
- Paris Carbone: Apache Flink Streaming. Resiliency and Consistency (Google Tech Talk, August 2015: SlideShare
- Andra Lungu: Graph Processing with Apache Flink (August 26th, 2015): SlideShare
- Till Rohrmann: Interactive data analytisis with Apache Flink (June 23rd, 2015): SlideShare
- Gyula Fóra: Real-time data processing with Apache Flink (Budapest Data Forum, June 4th, 2015): SlideShare
- Till Rohrmann: Machine Learning with Apache Flink (March 23th, 2015): SlideShare
- Marton Balassi: Flink Streaming (February 26th, 2015): SlideShare
- Vasia Kalavri: Large-Scale Graph Processing with Apache Flink (FOSDEM, 31st January, 2015): SlideShare
- Fabian Hueske: Hadoop Compatibility (January 28th, 2015): SlideShare
- Kostas Tzoumas: Apache Flink Overview (January 14th, 2015): SlideShare
2014
- Kostas Tzoumas: Flink Internals (November 18th, 2014): SlideShare
- Marton Balassi & Gyula Fóra: The Flink Big Data Analytics Platform (ApachecCon, November 11th, 2014): SlideShare
- Till Rohrmann: Introduction to Apache Flink (October 15th, 2014): SlideShare
License
This work (Awesome Flink, by https://github.com/wuchong/awesome-flink), identified by Jark Wu, is free of known copyright restrictions.