Hey, I've launched a dedicated job board for data engineers, analytics engineers and adjacent specialists. It is called GetDataEngineeringJobs.There are more than 1000+ sources that are processed on a regular basis (4 times a day). …
Read articleJust recently I wanted to create a custom middleware to augment the request object by adding an additional attribute to it. But I wanted this attribute to be lazy evaluated. If you have experience building …
Read articleI usually use RQ with Django because RQ is one of the most popular and straightforward solutions among task queues in the Python ecosystem. A few months ago I stumbled upon a situation where I …
Read articlePython has the wonderful package for recording logs called logging. You can find it in the standard library. Many developers think that it is overcomplicated and not pythonic. In this post I will try to …
Read articleMySQL is one of the most popular relational database in the world. I started my career as a web developer and used PHP with MySQL intensively in the past. When I transitioned to Python I …
Read articleThe demand for data engineers is growing rapidly. According to hired.com, the demand has increased by 45% in 2019. The median salary for Data Engineers in SF Bay Area is around $160k. So the question …
Read articleApache Airflow is an advanced tool for building complex data pipelines, it is a swiss-knife for any data engineer. If you look at the open positions for data engineers, you will see that the experience …
Read articlePostgreSQL is one of the most popular open source database. If you are building a web application you need a database. Python community likes PostgreSQL as well as PHP community likes MySQL. In order "to …
Read articleIt is interesting that many people working with data have no clue about window functions in SQL. During a long period of time instead of using window functions, I preferred coding in Python and pandas. …
Read articlepandas probably is the most popular library for data analysis in Python programming language. This library is a high-level abstraction over low-level NumPy which is written in pure C. I use pandas on a daily basis …
Read articlePart 1 — How To Create a Telegram Bot Using Python This is the second part of my small tutorial about creating a Telegram bot using Python and Django. Today I am going to show …
Read articleFor the past year, Telegram has introduced tons of new features including in-app games, bots, Telegraph and Instant Views, channels, groups and many more. What's going to be a next killer feature? Nobody knows. In …
Read articleCelery is the most advanced task queue in the Python ecosystem and usually considered as a de facto when it comes to process tasks simultaneously in the background. The lastest version is 4.0.2, community around …
Read article