• 0 Posts
  • 29 Comments
Joined 1 year ago
cake
Cake day: July 8th, 2023

help-circle

  • Elder millennial here. I had kids, my brother didn’t, and my kids, though young enough to change their minds, are adamant they won’t have kids.

    I think the more interesting stat likely unfolding is the marked decrease of great grandparents in a generation.

    To be clear this is not a “threat to society” or whatever, people can decide if they want kids or not. Just a shower thought.



  • I think this supports his argument. Having to research desktop environments to decide which is optimized for the potential problems a new user may face, then finding a distro that packages that DE is quite frankly too much for the average user.

    I’d argue between 3% and 5% of PC users are willing to research and experiment to find the flavor of Linux that truly works for them.

    Linux has come a long way, I still remember using Gentoo as a daily driver and seeing Linux cross 1% of desktop share, but the average desktop user doesn’t know the difference between a kernel and a colonel, and they don’t want to.




  • Just piling on at this point, but we made 2 changes last spring that made summer so much more tolerable in our house.

    1. More insulation. I bought a cheap thermal camera on Amazon and found entire closets and a bathroom with no insulation. Those rooms are a solid 10+ degrees cooler now.
    2. More ventilation. Half my house didn’t have any soffit vents, but had attic vents. Adding soffit vents made that half the house 5 degrees cooler all on its own.

    And we haven’t found ourselves needing it, but a mini split has popped up a lot here already and is a great idea.




  • Sure, self-hosting is a great option for very large projects, but a random python library to help with an analytics workflow isn’t going to self-host. Those projects, along with 27,999,990 others have chosen GitHub, often times explicitly to reduce the barrier to contribution.

    Also, all of those examples are built on thousands of other FOSS projects, 99% of which aren’t self-hosting. This is the same as arguing only Amazon is a bookseller and ignoring the thousands of independent book publishers creating the books Amazon is selling.




  • Lots of boring applications that are beneficial in focused use cases.

    Computer vision is great for optical character recognition, think scanning documents to digitize them, depositing checks from your phone, etc. Also some good computer vision use cases for scanning plants to see what they are, facial recognition for labeling the photos in your phone etc…

    Also some decent opportunities in medical research with protein analysis for development of medicine, and (again) computer vision to detect cancerous cells, read X-rays and MRIs.

    Today all the hype is about generative AI with content creation which is enabled with Transformer technology, but it’s basically just version 2 (or maybe more) of Recurrent Neural Networks, or RNNs. Back in 2015 I remember this essay, The Unreasonable Effectiveness of RNNs being just as novel and exciting as ChatGPT.

    We’re still burdened with this comment from the first paragraph, though.

    Within a few dozen minutes of training my first baby model (with rather arbitrarily-chosen hyperparameters) started to generate very nice looking descriptions of images that were on the edge of making sense.

    This will likely be a very difficult chasm to cross, because there is a lot more to human knowledge than thinking of the next letter in a word or the next word in a sentence. We have knowledge domains where, as an individual we may be brilliant, and others where we may be ignorant. Generative AI is trying to become a genius in all areas at once, and finds itself borrowing “knowledge” from Shakespearean literature to answer questions about modern philosophy because the order of the words in the sentences is roughly similar given a noun it used 200 words ago.

    Enter Tiny Language Models. Using the technology from large language models, but hyper focused to write children’s stories appears to have progress with specialization, and could allow generative AI to stay focused and stop sounding incoherent when the details matter.

    This is relatively full circle in my opinion, RNNs were designed to solve one problem well, then they unexpectedly generalized well, and the hunt was on for the premier generalized model. That hunt advanced the technology by enormous amounts, and now that technology is being used in Tiny Models, which is again looking to solve specific use cases extraordinarily well.

    Still very TBD to see what use cases can be identified that add value, but recent advancements to seem ripe to transition gen AI from a novelty to something truly game changing.







  • Yeah, model training is hard. Like capital H HARD. you need a bunch of data and it needs to be high quality.

    New York is the financial center of USA, so separating finance jobs from job postings written by someone using New England vernacular is a step you need to go through to make sure your data is high enough quality.

    So if you are just starting, use 20 newsgroups dataset in those links, it’s pretty good data with a ton of resources written about it. It’s not fun data, but it isn’t as likely to fall victim to biases in data you aren’t expecting.


  • Couple of options to start out with, Topic Labeling and Topic Extraction.

    • Topic Labeling is a classic example of supervised learning, or using ML with training data to classify new observations based on patterns found in training data.

    • Topic Extraction is a classic example of unsupervised learning, or attempting to identify patterns without training data.

    I’m going to start with labeling, or classification here. There are plenty of tools to train a model to classify text in to categories, I’d recommend starting with this scikit-learn tutorial to see what’s involved before you start.

    With any classification problem, you need good training data. You mentioned you’ve scraped 400 job postings, and I’m assuming you would want to using the job description to predict the job title. Some quick math, you’ll want to withhold 30% of your data to test your model, so that leaves 280 postings to train. I would recommend at least 100 descriptions per job title, so if you have 2-3 job titles, perfect, you’re ready to follow that tutorial with your own data!

    If you have more that that, you probably won’t be able to do labeling/classification here, and will instead want to do topic extraction, where you’ll throw your walls of text at the machine and let the machine tell you the patterns it finds.

    Topic modeling with spaCy and sci-kit learn is a great overview of this process, and plugging your own data in is pretty straightforward.

    Both of these examples don’t even really scratch the surface of what’s possible with text based ML these days, but are perfectly viable tools to run quickly and on commodity hardware.