Open in app

Sign In

Write

Sign In

Pradeep Singh
Pradeep Singh

41 Followers

Home

About

Pinned

Introduction to Cloud Composer

A Managed Airflow Service on Google Cloud — This is the first article of the series ‘Mastering Cloud Composer: A Comprehensive Guide to Managed Airflow on Google Cloud’. In this article, we will go through the below topics: Overview of Cloud Composer and its features Comparison with Airflow deployment options (e.g., self-managed, hosted) Benefits of using Cloud Composer…

Airflow

3 min read

Introduction to Cloud Composer
Introduction to Cloud Composer
Airflow

3 min read


Pinned

Discover the Magic of DAGs

The Key to Efficiently Modeling Complex Relationships — What is a DAG? A DAG is a type of graph that represents complex relationships between elements in a system using nodes and directed edges. DAG stands for Directed Acyclic Graph Directed — Edges have direction Acyclic — No cycles Graph — Set of nodes connected by edges DAG Architecture The architecture of a DAG can…

Dag

2 min read

Discover the Magic of DAGs - The Key to Efficiently Modeling Complex Relationships
Discover the Magic of DAGs - The Key to Efficiently Modeling Complex Relationships
Dag

2 min read


Pinned

Performance of Categorical Frequencies — SAS vs Python

In this article, we will compare the performance of the SAS Proc Freq procedure and Python libraries for analyzing categorical data. We will use the US Election 2020 Dataset and measure the time taken for various operations on the data using SAS and Python. This is the 2nd article for…

Sas

4 min read

Performance of Freq of Categorical Data — SAS vs Python
Performance of Freq of Categorical Data — SAS vs Python
Sas

4 min read


Pinned

Bigquery Architecture — Simplified

Bigquery is Google’s fully managed, serverless, highly scalable data warehouse that comes with a built-in petabyte scale query engine and has support for ANSI SQL and AutoML. But, how does Bigquery achieves this massive scale? 🤔 BigQuery’s serverless architecture decouples storage and computing and allows them to scale independently on…

Bigquery

6 min read

Bigquery Architecture — Simplified
Bigquery Architecture — Simplified
Bigquery

6 min read


Published in

Eduonline 24

·Pinned

Can we get SAS Proc Freq with Python?

This article will explore the SAS Proc Freq procedure and how we can achieve similar results using Python libraries. — Introduction to Proc Freq The frequency distribution of categorical variables is an essential part of descriptive statistics. SAS offers the freq procedure to easily achieve these stats. However, there are two reasons why one should know how to get frequency distribution in Python:

Python

6 min read

Can we get SAS Proc Freq with Python?
Can we get SAS Proc Freq with Python?
Python

6 min read


Mar 27

10 Pandas functions that will improve your Data Analysis Workflow

Pandas is a widely used and powerful Python library that facilitates data manipulation and analysis. Whether you are a data scientist, analyst, or someone who works with data regularly, mastering Pandas can significantly improve your work efficiency. …

Pandas

5 min read

10 Pandas functions that will improve your Data Analysis Workflow
10 Pandas functions that will improve your Data Analysis Workflow
Pandas

5 min read


Mar 20

Beyond ChatGPT

The Mind-Blowing AI Breakthroughs Being Developed by OpenAI — OpenAI is a world-renowned research organization that’s making groundbreaking advancements in the field of artificial intelligence. They’re constantly pushing the boundaries of what’s possible, and their work is shaping the future of technology in countless ways. …

AI

7 min read

Beyond ChatGPT
Beyond ChatGPT
AI

7 min read


Mar 13

Getting Started with Cloud Composer

Creating Your First Workflow Environment — This is the second article of the series ‘Mastering Cloud Composer: A Comprehensive Guide to Managed Airflow on Google Cloud’. Introduction to Cloud Composer A Managed Airflow Service on Google Cloudpsrajpoot.medium.com In this article, we will go through the below topics: A step-by-step guide to creating a new environment Overview of the Airflow web interface and CLI tools

Cloud Composer

4 min read

Getting Started with Cloud Composer
Getting Started with Cloud Composer
Cloud Composer

4 min read


Feb 27

Insights from 50+ Data Engineer Interviews that I took in the past year

As a team lead, I have conducted numerous interviews in the past year for the Data Engineer role. Throughout my experience, I’ve come across some common trends that have made me question the way we approach hiring. The following are some key observations I've made based on my experiences: Basic Knowledge Approximately…

Interview

3 min read

Insights from 50+ Data Engineer Interviews that I took in the past year
Insights from 50+ Data Engineer Interviews that I took in the past year
Interview

3 min read


Feb 21, 2021

I analyzed IPL 2021 Auction

Interesting insights from the IPL 2021 auction. In the 2021 Indian Premier League Auction, 292 Players tested their fate, whether they can play for any of the 8 franchises. Only 57 were lucky enough to get buyers. In this article, we will try to find answers to the following interesting…

Ipl

6 min read

I analyzed IPL 2021 Auction
I analyzed IPL 2021 Auction
Ipl

6 min read

Pradeep Singh

Pradeep Singh

41 Followers

MLOps Engineer @ Genpact / ml-ops.tech

Help

Status

Writers

Blog

Careers

Privacy

Terms

About

Text to speech

Teams