Onno (VK6FLAB)

Anything and everything Amateur Radio and beyond. Heavily into Open Source and SDR, working on a multi band monitor and transmitter.

#geek #nerd #hamradio VK6FLAB #podcaster #australia #ITProfessional #voiceover #opentowork

  • 0 Posts
  • 37 Comments
Joined 8 months ago
cake
Cake day: March 4th, 2024

help-circle















  • The underlying issue with an LLM is that there is no “learning”. The model itself doesn’t dynamically change whilst it’s being used.

    This article sets out a process that gives the ability to alter the model, by “dialling up” (or down) concepts. In other words, it’s changing the balance of the weight of concepts across the whole model.

    Altering one concept is hardly “learning”, especially since it’s being done externally by researchers, but it’s a start.

    A much larger problem is that the energy consumption is several orders of magnitude larger than that of our brain. I’m not convinced that we have enough energy to make a standalone “AI”.

    What machine learning actually gave us is the ability to automatically improve a digital model of things, like weather prediction, something that took hours on a supercomputer to give you a week of forecast, now can be achieved on a laptop in minutes with a much longer range and accuracy. Machine learning made that possible.

    An LLM is attempting the same thing with human language. It’s tantalising, but ultimately I think the idea applied to language to create “AI” is doomed.




  • I don’t know, but I doubt that the frequency response of a mobile phone microphone is either linear or consistent across sound level.

    I don’t even think you could compare two sounds with different frequencies, but I don’t know.

    I suspect that calibration of any such thing would require a whole lot of infrastructure, consider for example the angle of the phone in relation to sound and the impact of holding the phone in how it affects vibration and noise damping.

    You might be able to use a calibrated sound level meter and pair it via Bluetooth with your phone, but I think that’s going to be as close as you might get.

    In the past I’ve tried a wired USB microphone, but the OS isn’t real-time, so the jitter was horrendous. A pi would give you a more consistent result.