Sumários
Big-Data Processing: Stream Processing II (aula online)
28 maio 2021, 11:00 • Luís Antunes Veiga
Spark Streaming:
- overview, discretized stream processing
- windows, sliding windows, micro-batching
Flink:
- overview, windowing
- tumbling windows, sliding windows, custom windows
- time-based windows, watermarks
- state management, versioning,
- fault tolerance, distributed snapshots, execution semantics
- overview, windowing
- tumbling windows, sliding windows, custom windows
- time-based windows, watermarks
- state management, versioning,
- fault tolerance, distributed snapshots, execution semantics
Big-Data Processing: Workflows/Dataflows and Stream Processing I (aula online)
27 maio 2021, 16:00 • Luís Antunes Veiga
Pig:
- overview, Pig Latin
- main operators
- key manipulation, map-related, reduce-related
Spark:
- overview, RDDs
- programming model, examples
- RDD operations
- fault-tolerance, performance
- overview, RDDs
- programming model, examples
- RDD operations
- fault-tolerance, performance