Relative Content

Tag Archive for apache-flink

flinkcdc 2.4 snapshot.select.statement.overrides how to config

I need use flinkcdc 2.4 capture data from mysql , I need write a backfill program, I want to do a initial mode just capture the subset of the table, I find the property snapshot.select.statement.overrides, but it does not work, I find a issue in github
https://github.com/apache/flink-cdc/discussions/1131
it said the scan.incremental.snapshot.enabled should be false, but how to config this property to false in datastream api? thanks

Add custom metric in jobmanager

When I start the Flink JobManager, I see some standard metrics such as flink_jobmanager_Status_JVM_ClassLoader_ClassesLoaded and flink_jobmanager_Status_JVM_Memory_Mapped_TotalCapacity.

Metrics short lived jobs

I’m launching a job (automatically detected as batch) that reads a csv (3 records) and outputs the same content to Kafka. At the end of this job, which takes about 3s to run, I need to get some metrics, including custom ones.