From 2/10/2011, 9:40:05 PM till now, @llambda has achieved 58249 Karma Points with the contribution count of 3760.
Recent @llambda Activity
It's a great question: fundamentally the Parquet format offers columnar orientation. With datasets like these, there's some research[0] indicating this is a preferable way of storing and querying WARC.
DuckDB, like SQLite, is serverless. Duck has a leg up on SQLite though when it comes to Parquet: Parquet is supported directly in Duck and this makes dealing with these datasets a breeze.
[0] https://www.researchgate.net/figure/Comparing-WARC-CDX-Parqu...
Show HN: Easily Convert WARC (Web Archive) into Parquet, Then Query with DuckDB
116 points • 15 comments
Lavarand
6 points • 0 comments
Show HN: Convert WARC (Web Archive) Files to Parquet and Query with DuckDB
3 points • 0 comments
I'm disappointed to see there isn't Redshift support. What's on the roadmap to address that?
Ask HN: What are the best engineering brands in 2021?
27 points • 5 comments
Pathstream | REMOTE or San Francisco, CA | https://pathstream.com/
Pathstream gives people the path to a good career.
We're building the technology platform to help folks up-skill and succeed in the modern digital economy.
We're hiring for staff and fullstack engineering roles.
Reach out to me directly: maxc@pathstream.com or apply via Greenhouse.
Staff Software Engineer: https://boards.greenhouse.io/pathstream/jobs/4570108003
Fullstack Software Engineer: https://boards.greenhouse.io/pathstream/jobs/4174105003
Ubuntu Philosophy
95 points • 48 comments
Effective Airflow Development
58 points • 26 comments
Ubuntu Philosophy
2 points • 0 comments
Effective Airflow development
10 points • 0 comments
Curology | Engineering Manager, Platform Engineer, Data Engineer, and many others! | San Francisco, CA | Full-Time, Onsite
Engineering Manager
Curology's Platform Engineering Team is looking for a passionate, experienced, and creative data engineering manager to lead, grow, and mentor the Data Platform Team. As an Engineering Manager of the Data Platform Team, you will work closely across teams to design and implement the pipelines and infrastructure that power our data science, business insights, and marketing efforts. The perfect candidate will have strong data infrastructure and data architecture skills, a proven track record of leading and scaling engineering teams, strong operational skills to drive efficiency and speed, strong project management leadership, and a strong vision for how data can proactively improve companies. This is a full-time position based in our San Francisco office.
More roles on our careers page: https://curology.com/careers
Questions? Please reach out to derrick@curology.com or max@curology.com!
The Passport: A Tool for Better Metrics (2016)
16 points • 1 comments
Curology | San Francisco, CA | DevOps and Data Engineers | $130k-$175k | FULL-TIME | ONSITE | https://curology.com
ABOUT US: Curology is a telemedicine startup focused on making dermatology accessible to everyone. We're growing quickly—300% in the past year alone—and creating excitement by helping real people see life-changing improvements in their skin.
HIRING: We're looking for talented devops and data engineers to lead development of our infrastructure and data engineering efforts. There are a lot of interesting and challenging problems to solve for both roles--scaling and privacy are top-of-mind.
BENEFITS: Relocation, competitive salary, meaningful equity, free food, health insurance, open vacation policy
These are two separate roles and the details of each can be found on AngelList:
DevOps - https://angel.co/curology/jobs/424386-devops-engineer
Data Engineer - https://angel.co/curology/jobs/426336-data-engineer
Apply via AngelList or shoot me an email: max+hn@curology.com (please include "Who is hiring" in your subject line).
SEEKING WORK - San Francisco or Remote
I am a polyglot, full-stack developer with ~10 years experience. My specialties are Python, Flask, Clojure, Node, and React as well as professional experience with MongoDB and Postgres. I am reliable, easy to work with, quick to turn things around, and a good communicator. I am available to work either on my own or as part of your team. Client satisfaction is my top priority.
Some of my open source work is available here:
https://github.com/maxcountryman
I can also provide work samples and references upon request.
Please do not hesitate to reach out: maxc@me.com
Location: San Francisco
Remote: Preferred
Willing to relocate: SE Asia only (i.e. Singapore)
Technologies: Python, Flask, Javascript, Node, React, Clojure, Postgres, MongoDB
Résumé/CV: Available upon request
Email: maxc@me.com
I am a polyglot, full-stack developer with ~10 years experience. My specialties are Python, Flask, Clojure, Node, and React as well as professional experience with MongoDB and Postgres. I am reliable, easy to work with, quick to turn things around, and a good communicator. I am available to work either on my own or as part of your team. Client satisfaction is my top priority.
Some of my open source work is available here:
https://github.com/maxcountryman
I can also provide work samples and references upon request.
The Passport: A Tool for Better Metrics (2016)
1 points • 0 comments
Go is not good
3 points • 0 comments
Oh come on. Please do not troll. That says absolutely nothing about functional programming in general and absolutely everything about the publisher. Not only could this not be further from the truth, but it's a cheap and lazy attack on a rigorous and proven paradigm. Give it a try. You might just surprise yourself.
PHP 7 at Tumblr
303 points • 51 comments
site design / logo © 2022 Box Piper