Tariqul IslamJAVA App for Spark job and Run on GCP DataProc and Storage (Spark Code Practice 3)In this article, I will discuss about how to use java application with maven to work with spark, build JAR to use for spark job. and how we…8 min read·Nov 28, 2023----
Tariqul IslamPySpark and GCP Dataproc Sample(Basic Understanding)Dataproc GCP service, which provide the cluster with hadoop,hive, metastore and spark pre installed.Which is a pay as you go service, this…5 min read·Nov 17, 2023----
Tariqul IslamApache Spark (PySpark) with JSON and Hadoop (Code Practice Part 2)In this code practice, I will discuss about the several functions about spark sql json function, which support to read json file and field…7 min read·Nov 15, 2023----
Tariqul IslamHadoop , Hive, Shell Script(BASH), Beeline and hiveserver2 (Data Pipeline Automation Part 2)Using Shell Script with Hive and Hadoop, we can build robust automated data pipeline solution for project. In this part i will discuss…14 min read·Nov 6, 2023----
Tariqul IslamApache Spark with HDFS, HIVE and Hadoop (Code Practice Part 1)Apache Spark is data analysis engine, we can use it process the bigdata with it, Spark is 100 times faster than hive, better tool selection…13 min read·Oct 20, 2023----
Tariqul IslamHadoop , Hive, Python and Azkaban Scheduler (Data Pipeline Automation Part 1)Automating the data pipeline is challenging works for any software development environment. To handle Big Data and Unstructured data…11 min read·Oct 18, 2023----
Tariqul IslamNext Js with Minikube (Kubernetes)In this Article, I will discuss about how the NextJS can be deployed into Minikube(Kubernetes) environment. I also discuss about the how to…8 min read·Apr 10, 2023----
Tariqul IslamInstall MiniKube in windows with Docker DriverInstall Docker Desktop on Windows4 min read·Oct 26, 2021----
Tariqul IslamSimple App From Scratch and Upload File with Django FrameworkDjango web framework is a repid web application development framework. I have been using this framework in different project11 min read·Jun 25, 2021----