Build a Real-time Stream Processing Pipeline with Apache Beam
講者: 蔡勝文 / Data Engineer @ 17 Media 時段: 15:10~15:50 地點: 科技大樓 國際會議廳 講題: Build a Real-time Stream Processing Pipeline with Apache Beam |
摘要:
– Real-time Stream Pipeline for live-stream quality monitoring
– Use Google Pubsub, Dataflow, BigQuery, Data studio fast developing
– Real-time merge information with different data-source
– Real-time dashboard with BigQuery & Data studio
講者簡介:
現職: 17media Data Engineer
- Applications using the Class Frequency Distribution of Maximal Repeats from Tagged Sequential Data
- AI at PIXNET