Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Binary file added docs/assets/images/PavanReddy.jpeg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
11 changes: 6 additions & 5 deletions docs/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -17,12 +17,13 @@ of Texas and beyond.

## Upcoming PyTexas Meetups

### March Meetup - March 4, 2025
### April Meetup - April 1, 2025

#### Accelerate your pandas application with FireDucks; A multi-threaded DataFrame library with JIT Compiler - Sourav Saha
#### Boosting Python’s Performance With Multiprocessing to Bypass the GIL - Pavan Reddy

In this talk, I will introduce [FireDucks](https://fireducks-dev.github.io), that comes with a multithreaded kernel backend written in C++, a JIT compiler to auto-detect and optimize the existing performance issues involved in a user program, and a pure python frontend highly compatible with pandas allowing a native pandas application to be executed as it is without any manual changes. With the promise of highly compatible pandas APIs and the revved-up performance, FireDucks can serve the demands of this digital age and transform the arduous task of data wrangling into a more efficient and less taxing endeavor. It can be simply installed on any Linux system using pip.
This talk explores Python’s Global Interpreter Lock (GIL), a limitation that restricts true parallel execution in multi-threaded programs. We examine how multiprocessing enables parallelism by bypassing the GIL, resulting in significant performance gains for CPU-bound tasks. Attendees will learn practical techniques to use multiprocessing effectively for scalable, high-performance Python applications.

![Sourav Saha Avatar](assets/images/Sourav_Saha.jpg){: style="height:150px;width:150px" align=left}
![Pavan Reddy Avatar](assets/images/PavanReddy.jpeg){: style="height:150px;width:150px" align=left}

*Sourav has 11 years of professional experience at NEC Corporation, Japan in the diverse fields of High-Performance Computing, Distributed Programming, and Data Science. He holds a bachelor’s degree in Computer Science and is currently affiliated with the Digital Technology Development Laboratories at NEC as a Senior Research Engineer. Blending the mixture of different niche technologies related to compiler framework, high performance computing, and multi-threaded programming, his team is developing a high-performance compiler accelerated DataFrame library, named FireDucks. He is mostly passionate about program optimization, public speaking and has been speaking in several technical conferences, meetups etc.*
*Pavan earned his M.S. in Computer Science from George Washington University, where he also served as a teaching assistant, delivering lectures on Computer Vision concepts in the context of Augmented Reality (AR) and Virtual Reality (VR). Currently, he works as a software engineer specializing in Artificial Intelligence (AI) and Machine Learning (ML), with a focus on Adversarial Attacks and Explainable AI. Driven by a deep passion for ML and its transformative potential, Pavan became an educator to share his knowledge and help others understand ML in intuitive ways. Through his popular Instagram page, he has amassed a dedicated following of over 90,000 enthusiasts, making complex ML concepts accessible and empowering individuals to engage with technology that can contribute to a better, more
impactful world.*
5 changes: 4 additions & 1 deletion docs/past_meetups/.authors.yml
Original file line number Diff line number Diff line change
Expand Up @@ -71,4 +71,7 @@ authors:
name: Dishant Sethi
description: I’m Dishant! I’m a computer science graduate with over 5 years of experience in software development, cloud infrastructure, and AI/ML pipelines. I’ve had the opportunity to work with a few early-stage startups in Boston and New York, providing software consultancy. These days, I’m focused on building AI applications, helping teams solve technical challenges and build scalable solutions. When I’m not working on tech, you’ll probably find me in the kitchen, experimenting with new recipes. Feel free to reach out if you would like to talk about product engineering, AI, or cooking.
avatar: https://avatars.githubusercontent.com/u/31399916

souravsaha:
name: Sourav Saha
description: Sourav has 11 years of professional experience at NEC Corporation, Japan in the diverse fields of High-Performance Computing, Distributed Programming, and Data Science. He holds a bachelor’s degree in Computer Science and is currently affiliated with the Digital Technology Development Laboratories at NEC as a Senior Research Engineer. Blending the mixture of different niche technologies related to compiler framework, high performance computing, and multi-threaded programming, his team is developing a high-performance compiler accelerated DataFrame library, named FireDucks. He is mostly passionate about program optimization, public speaking and has been speaking in several technical conferences, meetups etc.
avatar: ../assets/images/Sourav_Saha.jpg
25 changes: 25 additions & 0 deletions docs/past_meetups/posts/2025-03-04.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,25 @@
---
title: "Celery and Its Challenges in Production"
description: Dishant talked about Celery and the unique challenges of running it at scale.
date: 2025-03-04
categories:
- Pandas
- FireDucks
- DataFrame
- Data Analysis
authors:
- souravsaha
---

# February 2025 Meetup

Sourav talked about Pandas and FireDucks!

<!-- more -->
![Sourav Saha Avatar](assets/images/Sourav_Saha.jpg){: style="height:150px;width:150px" align=left}

#### Accelerate your pandas application with FireDucks; A multi-threaded DataFrame library with JIT Compiler - Sourav Saha

In this talk, I will introduce [FireDucks](https://fireducks-dev.github.io), that comes with a multithreaded kernel backend written in C++, a JIT compiler to auto-detect and optimize the existing performance issues involved in a user program, and a pure python frontend highly compatible with pandas allowing a native pandas application to be executed as it is without any manual changes. With the promise of highly compatible pandas APIs and the revved-up performance, FireDucks can serve the demands of this digital age and transform the arduous task of data wrangling into a more efficient and less taxing endeavor. It can be simply installed on any Linux system using pip.

*Sourav has 11 years of professional experience at NEC Corporation, Japan in the diverse fields of High-Performance Computing, Distributed Programming, and Data Science. He holds a bachelor’s degree in Computer Science and is currently affiliated with the Digital Technology Development Laboratories at NEC as a Senior Research Engineer. Blending the mixture of different niche technologies related to compiler framework, high performance computing, and multi-threaded programming, his team is developing a high-performance compiler accelerated DataFrame library, named FireDucks. He is mostly passionate about program optimization, public speaking and has been speaking in several technical conferences, meetups etc.*
11 changes: 4 additions & 7 deletions requirements.txt
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,8 @@
# uv pip compile requirements.in -o requirements.txt
babel==2.17.0
# via mkdocs-material
backrefs==5.8
# via mkdocs-material
cairocffi==1.7.1
# via cairosvg
cairosvg==2.7.1
Expand All @@ -15,10 +17,7 @@ charset-normalizer==3.4.1
click==8.1.8
# via mkdocs
colorama==0.4.6
# via
# click
# mkdocs
# mkdocs-material
# via mkdocs-material
cssselect2==0.7.0
# via cairosvg
defusedxml==0.7.1
Expand Down Expand Up @@ -51,7 +50,7 @@ mkdocs==1.6.1
# mkdocs-redirects
mkdocs-get-deps==0.2.0
# via mkdocs
mkdocs-material==9.6.1
mkdocs-material==9.6.7
# via -r requirements.in
mkdocs-material-extensions==1.3.1
# via
Expand Down Expand Up @@ -87,8 +86,6 @@ pyyaml==6.0.2
# pyyaml-env-tag
pyyaml-env-tag==0.1
# via mkdocs
regex==2024.11.6
# via mkdocs-material
requests==2.32.3
# via mkdocs-material
six==1.17.0
Expand Down