Suchit GuptaSpark with Prometheus monitoringGet spark jobs running in Kubernetes with Prometheus monitoring.4 min read·Feb 25, 2021--1--1
Suchit GuptaPrometheus on Docker-On-MacA step by step guide to set up a prometheus server on local K8 cluster2 min read·Feb 25, 2021----
Suchit GuptaZeppelin in KubernetesStep to step guide to deploy Zeppelin for multi users in Kubernetes3 min read·Jan 13, 2021----
Suchit GuptaSpark 3.0.0 history server with minIOA step by step guide on setting up Spark history server backed by minIO in Kubernetes3 min read·Oct 22, 2020----
Suchit GuptaRun Spark 3.0.0 on KubernetesA step by step guide on running your local spark scala code on Kubernetes using spark-on-k8s-operator.3 min read·Oct 16, 2020----
Suchit GuptaUse Spring Scheduler In Clustered EnvironmentAt most once at the same time in Spring Scheduler.2 min read·Jun 26, 2020----
Suchit GuptaSpring Boot with Flyway PlaceholdersPlay around with multiple schemas in your flyway scripts by using Flyway placeholders.1 min read·Jun 2, 2020----
Suchit GuptaMySQL to PostgreSQL using Kafka ConnectOur objective would be to quickly set up a data pipeline and move data from MySQL to PostgreSQL.3 min read·May 31, 2020----
Suchit GuptaIntegration Testing in Spark Structured StreamingA guide for writing integration test for a Spark Structured Streaming Application5 min read·May 26, 2020--1--1
Suchit GuptaSpark Streaming with Kafka-Connect Debezium ConnectorA quick guide to set up Debezium and use Spark-Streaming Job as a Kafka consumer.5 min read·May 17, 2020--1--1