What I learned this week Software Better python notebooks Map of github Bloom Filters to speed up Joins in SQLite A good deep dive on Bloom Filters from Sam Bloom filters can give definite “no"s, but they can’t be certain about “yes.” A bloom filter will never give a false-negative, and this is what makes them useful. Google’s BigTable is a distributed key-value store, and uses bloom filters internally to know what keys are stored within.

What I learned this week Software DuckDB interview & cocaine fund. You find yourself in a quest for productivity, feeling productive because of the quest, but not really doing any productive work. DNS rabbit hole Stripe Blog Business/Finance Interesting Links Math/Stats Travel Other Interesting things learned One thing I found particularly absurd Inhaling carbon monoxide for performance Human brain is unreal

What I learned this week Software Great video on threading Cluster by, partition and sort does not guarantee a total order of output. Business/Finance Interesting Links Math/Stats Travel Other Movies to Watch: Barry Lyndon, Casablanca, and Network. Went to chess club on Wednesday, played over the board for the first time in several years. I played a decent French Defense in my first game and ended up losing after miscalculating. I completely imploded when playing another guy losing three games quickly and even accidentally swapping the position of my king and queen when setting up the board.

What I learned this week Software Iceburg S3 Conditional Writes S3 is a database Business/Finance Interesting Links Math/Stats Travel Other Enjoyed spending time with family on Thanksgiving. Tried my best to do focus as much as possible with them and be off the phone. I worked a few days during the week but was very efficient with my time and made sure I stopped working and stayed not working through evenings and early mornings.

What I learned this week Software Add line numbers to head: head -n 5 example.csv | nl R cheatsheets Hamming codes When using psql from the command line don’t forget to end statements with a ‘;’. Business/Finance Acquired Ikea episode “It is not all that difficult to reach set targets if you do not have to count the cost. Any designer can design a desk that will cost 5000 krona. But only the most skilled can design a good, functional desk that will cost 100 krona.

What I learned this week Postgres knowledge dump Software Business/Finance $26BB of BTC $71BB market cap… Interesting Links Math/Stats Travel Other Cool fossils building a picnic table I really enjoy Beau’s videos.

What I learned this week Software Nice overview of jq, was using the aws emr cli to describe clusters so I could SSH into them aws emr describe-cluster –cluster-id and decided to use jq instead of grep -i dns I guess you can use spark in Athena echo {1..10} returns 1-10 < lines awk ‘NR%2 == 0’ filtering raw lines out of text file with awk is pretty handy < lines sample -r 10% quick “random” sample

What I learned this week Software arp -a The arp utility displays and modifies the Internet-to-Ethernet address translation tables used by the address resolution protocol. -a displays or deletes all of the current ARP entries. I passed the AWS Certified Cloud Practiioner Exam this week. I studied for a few hours to make sure I was familiar with some of the more niche offerings and all the marketing jargon that will appear on the test.

What I learned this week Software **.suffix in git ignore, especially helpful if you have a 100mb database locally and a write ahead log. Postgres MVCC Business/Finance Interesting Links Space Suits Math/Stats Travel Other Building a Neural network in pure SQL is hard!

What I learned this week Software Shell You can us curl to make requests using the DICT protocol curl -s "dict://dict.org/d:windmill" | trim Other curl things: -I for HTTP header, -L for redirection unpack handy tool for decompression You can use rm and a pattern to remove all files in a directory rm E1F* removes all files that start with E1F Dagster + DBT Dagster Assets = DBT Models: dbt models are named using file names, which Dagster will also use to create the corresponding asset’s asset key.