10 January 2021

SQL Querying a log stream and outputting Calculations to another stream

Initially published on https://medium.com/data-querying/live-sql-querying-live-logs-and-sending-live-updates-easily-e6297150cf92 Log analysis tutorial from an Apache Kafka data stream via Flink SQL, ksqlDB & Hue Editor. Real time queries on streams on data is a modern way to perform powerful analyses as demoed in the previous post. This time we will see a more personalized scenario by querying our own logs generated in the Web Query Editor. First, thank you to the community for all the improvements on the open source projects mentioned below, with in particular Flink Version 1.…

3 minutes read - Tutorial / Version 4.9 / Flink SQL / ksqlDB

20 October 2020

Tutorial on querying live streams of data with Flink SQL

Real time data querying is becoming a modern standard. Who wants to wait until the next day or week when needing to take decision now? Apache Flink SQL is an engine now offering SQL on bounded/unbounded streams of data. The streams can come from various sources and here we picked the popular Apache Kafka. This tutorial is based on the great Flink SQL demo Building an End-to-End Streaming Application but focuses on the end user querying experience.…

4 minutes read - Tutorial / Version 4.9 / Flink SQL

15 September 2020

SQL Querying Improvements: Phoenix, Flink, SparkSql, ERD Table...

Hi Data Crunchers, Are you looking at executing your SQL queries more easily? Here is a series of various querying improvements coming in the next release of Hue! New Databases Hue is getting a more polished experience with Apache Phoenix, Apacke Flink SQL and Apache Spark SQL (via Apache Livy). Apache Phoenix Apache Phoenix makes it easy to query the Apache HBase database via SQL. Now the integration is fully working out of the box and several corner cases (e.…

4 minutes read - Version 4 / Phoenix / Flink SQL / ksqlDB / Spark SQL

06 May 2020

SQL Editor for Apache Flink SQL

Flink SQL Editor This is the very first version of the SQL Editor for Flink. The goal is to demo how to execute Flink SQL queries. We use the new Flink SQL gateway project and point to a Flink cluster with live data in a docker container. Hue is used as the SQL Editor for querying Flink tables. Feel free to read more about Flink SQL and continuous queries. Setup Any Flink 1.…

4 minutes read - Version 4 / Flink SQL