From Dev.to Community
Tech Articles
Curated developer articles, tutorials, and guides — auto-updated hourly
Jubin Soni1d ago • 10 min read
Apache Spark Query Optimization on Databricks: Catalyst, AQE, and Photon Engine
A deep dive into how Spark transforms your SQL into a physical execution plan — and how Databricks.....
#databricks#spark#python#performance
1 0
Jubin Soni1d ago • 10 min read
Real-Time AI Feature Engineering with Spark Structured Streaming and Databricks Feature Store
Building point-in-time correct, production-grade feature pipelines — from raw Kafka events to online...
#databricks#spark#ai#python
1 0
NaksharaLabs5d ago • 3 min read
Skill Evolution in the AI-Augmented Workforce
⚡ Spark As AI systems handle increasingly complex cognitive tasks, the human workforce is...
#ai#devresolutions2024#spark#programming
0 0
Israel Mendes3d ago • 12 min read
What is the best data compression for data lakes? (with benchmark!)
Every time that I'm in a project starting a data lake or storing some information in a blob storage....
#datalakes#datacompression#analytics#spark
0 0