{"id":31,"date":"2022-10-01T12:00:00","date_gmt":"2022-10-01T12:00:00","guid":{"rendered":"https:\/\/blog.marcinpolkowski.com\/?p=31"},"modified":"2022-10-04T16:36:01","modified_gmt":"2022-10-04T16:36:01","slug":"passion-for-data-and-plane-travel","status":"publish","type":"post","link":"https:\/\/blog.marcinpolkowski.com\/?p=31","title":{"rendered":"Passion for data and plane travel"},"content":{"rendered":"<p>I&#8217;m very enthusiastic about both data science and plane travel. I found a way of combining these two passions. It stared from my frequently visiting flight tracking websites like <a href=\"https:\/\/globe.adsbexchange.com\/\">adsbexchange.com<\/a> or <a href=\"https:\/\/www.flightradar24.com\/\">flightradar24.com<\/a>. The next step for me was to build my own ADS-B receiver using Raspberry Pi. I stared with small antenna by the windows and quickly changed my setup to use big antenna on the top of my house. My Raspberry collects and shares data for over 8 years now (that reminds me, that I&#8217;ve never updated it). It receives signals from planes as far as 250 miles from my house. I&#8217;ve done some interesting data science using this data, but quickly realized that I&#8217;m hungry for more data.<\/p>\n<p>Over 4 years ago I had an idea to start collecting data about all planes around the globe and storing it in the database for future science. I spend time searching for data sources, designing the database and all related processes and finally started collecting data. I started collecting data in November 2018.<\/p>\n<p>Today, almost 4 years later I have a decent database to play with. The database is over 16 billion rows (1.6e10) and occupies almost 3 TB of disk space. I&#8217;m using Google BigQuery to store the data ans Docker to run the whole related infrastructure.<\/p>\n<p>I&#8217;m going to share some of the most interesting analysis I was able to do with this data. I hope you will find it interesting and maybe even useful. Stay tuned!<\/p>\n<p><center><a href=\"https:\/\/blog.marcinpolkowski.com\/wp-content\/uploads\/2022\/10\/PlaneActivityAfterJune1st2022.png\"><img decoding=\"async\" src=\"https:\/\/blog.marcinpolkowski.com\/wp-content\/uploads\/2022\/10\/PlaneActivityAfterJune1st2022.png\" style=\"width:60%\"><\/a><\/center><\/p>\n","protected":false},"excerpt":{"rendered":"<p>I&#8217;m very enthusiastic about both data science and plane travel. I found a way of combining these two passions. It stared from my frequently visiting flight tracking websites like adsbexchange.com or flightradar24.com. The next step for me was to build my own ADS-B receiver using Raspberry Pi. I stared with small antenna by the windows [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[5],"tags":[],"class_list":["post-31","post","type-post","status-publish","format-standard","hentry","category-flight-data"],"_links":{"self":[{"href":"https:\/\/blog.marcinpolkowski.com\/index.php?rest_route=\/wp\/v2\/posts\/31","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.marcinpolkowski.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.marcinpolkowski.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.marcinpolkowski.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.marcinpolkowski.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=31"}],"version-history":[{"count":2,"href":"https:\/\/blog.marcinpolkowski.com\/index.php?rest_route=\/wp\/v2\/posts\/31\/revisions"}],"predecessor-version":[{"id":34,"href":"https:\/\/blog.marcinpolkowski.com\/index.php?rest_route=\/wp\/v2\/posts\/31\/revisions\/34"}],"wp:attachment":[{"href":"https:\/\/blog.marcinpolkowski.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=31"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.marcinpolkowski.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=31"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.marcinpolkowski.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=31"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}