Al Sutton

CTO at Snapp Automotive. ex-Google, ex-Facebook. The opinions stated here are my own. #tfr

Blog: https://www.alsutton.blog
GitHub: https://github.com/alsutton

Public Key

npub1jdqvsusxwz52vxprusmzsu8qpsrq7q3ya3rxl7zdff5q5kkrq5sqfx60zy

NIP-05 Address

alsutton_at_snapp.social@momostr.pink

Profile Code

nprofile1qqsfxsxgwgr8p29xrq37gd3gwrsqcps0qgjwc3n0lpx556q2ttps2gqprpmhxue69uhhyetvv9ujumt0d4hhxarj9ecxjmntjhdzgm

Publishing to

relay.momostr.pink

Author Public Key

npub1jdqvsusxwz52vxprusmzsu8qpsrq7q3ya3rxl7zdff5q5kkrq5sqfx60zy

Show more details

Last Notes

2025-07-02 10:06:01 UTC

Oh the joy of having to block AI bots from scraping some public repos we host from the bot with the signature
"KHTML, like Gecko; compatible; GPTBot/1.2; +https://openai.com/gptbot"
I hope they read the license for all the code before using it ;)

2025-07-01 19:13:16 UTC

Today's #wtf computing moment; There seems to be no way to let a downloaded, command line executed, app on #macos have access to my LAN unless the developer does some magic to it (e.g. doing a local network request at startup).
This means the shared cache I have on my LAN for my act_runner instances can't be used by the runners on macos, because macos blocks access to it.
🤯
#Forgejo #Gitea
https://gitea.com/gitea/act_runner/issues/711

2025-07-01 11:21:38 UTC

This seems, to me, to meet the definition of “creative accounting” 😂 https://nypost.com/2025/06/30/world-news/italy-finds-16-billion-loophole-to-hit-5-defense-spending-pledge-a-bridge-to-sicily/

2025-07-01 10:32:19 UTC

It’s *really* difficult to recommend using the #eurostar when this is the experience you have in Gare du Nord in Paris on one of the hottest days of the year.
The staff were repeatedly asking folk to move in closer to each other, the ticket check barriers printed new tickets for dome folk with different seat numbers, splitting up families, due to a “technical fault”, the announcements to ignore the gate printed tickets were so quiet most folk didn’t hear them, and the train was 40 mins late.
https://media.snapp.social/media_attachments/files/114/777/517/967/020/087/original/c2e1cc0830f643b8.jpeg

2025-06-28 11:27:52 UTC

- reply

Thinking 5 years out, we could be in a place where, for some information, the authoritative sites have gone out of business, and others have just given up trying to get views, so Google’s answers become even worse because its data sources (the sites) are not updated or don’t exist any more. There’ll also be no good site link results because there are no good sites trying to compete with AI answers.
Seems like a new form of #Internet #enshitfication could be on the way.
#Google #AI

2025-06-28 11:12:05 UTC

Interesting effect of #Google’s #AI answer box; Sites used to get visitors by folk clicking on search result answers, but now the sites creating the content see nothing because their site is ingested and the content, or a derivative, is shown by Google directly to users as part of an AI response.
This massively cuts the number of visitors some sites get, and has knock-on effects for monetisation, viability, etc.
I’ll be ignoring the AI box from now on.
Source; https://www.reddit.com/r/Entrepreneur/s/Kz4xCsGOkG
https://media.snapp.social/media_attachments/files/114/760/687/415/362/098/original/23ad6adac2d975fa.jpeg

2025-06-27 20:20:50 UTC

If you though #Google was achieving anything in relation to reducing carbon emissions, read pages 80-82 of their environmental report.
They try hard to make it look like they’ve achieved something by calling out “avoided emissions” on a graph showing a multi-year upward trend in actual emissions.
Even when, as a planet, we’ve seen multiple years of unprecedented destructive weather anomalies the “Don’t be Evil” company is failing to tame its emissions.
We’re screwed.
https://www.gstatic.com/gumdrop/sustainability/google-2025-environmental-report.pdf

2025-06-26 16:22:46 UTC

Oh great, now I can’t trust the emails from #Google not to change between reading.
One of the reasons I value email is for the ability to store what’s been said at a point in time and refer back to it knowing it will not change, kind of like, books or letters.
https://media.snapp.social/media_attachments/files/114/750/584/367/493/530/original/d64f243425245236.png

2025-06-21 09:10:18 UTC

It’s important that everyone is playing by the same rules.
https://media.snapp.social/media_attachments/files/114/720/572/350/852/689/original/c43d45a4a24b664b.jpeg

2025-06-20 16:19:13 UTC

This actually looks like a decent remake 🤞https://www.youtube.com/watch?v=uLguU7WLreA

2025-06-20 11:37:49 UTC

I wonder how many folk use the table service QR code ordering system when the QR code takes you to a page like this…
https://media.snapp.social/media_attachments/files/114/715/489/977/702/951/original/4192ff92d1277e2e.jpeg

2025-06-18 10:29:14 UTC

- reply

I’ve not seen anything using it so far. I suspect there’ll be some time to see how it develops before there’s a large scale buy-in.

2025-06-18 09:15:32 UTC

Heads up folks. #slack is joining the list of companies who think it’s OK to opt groups of users into an #AI / #LLM system without their explicit consent.
https://media.snapp.social/media_attachments/files/114/703/606/058/677/962/original/1bb485621af88874.jpeg

2025-06-17 19:21:52 UTC

If you want to improve your knowledge of where countries are, and how far apart they are, I can recommend this game… https://globle.org/?

2025-06-17 10:53:11 UTC

Despite what many purchasing departments think, software developers are not fungible assets...
https://www.linkedin.com/feed/update/urn:li:activity:7340664517355290625/

2025-06-16 17:17:05 UTC

- reply

Thanks! btw, the emulator needs you to turn on WiFi manually. If you do that you’ll get a map in the launcher.

2025-06-16 11:28:45 UTC

🤞 https://www.telegraph.co.uk/business/2025/06/16/britain-to-keep-lights-on-gas-free-power-grid-first-time/

2025-06-14 09:54:14 UTC

Some days it just blows my mind how some pieces of software have gained so much traction, with so little in the way of support for some common use cases.
Today; #Docker running on an IPv6 only host.
Who thought assigning IPv4 addresses to containers running on an IPv6 only host was a sensible default that is so difficult to override?
🤯

2025-06-13 11:04:00 UTC

Oh man, this is a trip down memory lane… https://m.youtube.com/watch?v=buuUZFh_pyk

2025-06-13 10:18:48 UTC

There are some things that you should just not get involved in. https://apple.news/A7_mxU4BeRyK22qHiCeasLg

2025-06-13 08:49:56 UTC

- reply

Thank you for fighting for it. It has been very useful in ways that I don’t think Google realise, so it definately is a sad time.

2025-06-12 16:35:34 UTC

Thanks to the Dependency Check + daily scan, vulnerabilities like this now get flagged pretty quickly so we can do an out-of-schedule dependency bump.
One less thing to worry about :)
#DevOps
https://euvd.enisa.europa.eu/vulnerability/EUVD-2025-18118

2025-06-12 06:06:03 UTC

Interesting to watch the reaction to #Pixel device build files not being included in the #AOSP release for #Android 16.
This could cause a lot of problems for folk creating #degoogle firmware for Google devices.

2025-06-12 05:47:31 UTC

- reply

Library authors having vulnerable dependencies flagged to them, and then pushing new releases that resolves the issue.
Doing this can be automated.

2025-06-11 12:11:13 UTC

Hello #Android #Automotive OS 16.... Looks like the left panel has changed, and there's now an assistant button where the volume button was before, but, on the whole, #Android16 #AAOS from the #AOSP seems very familiar.
https://media.snapp.social/media_attachments/files/114/664/660/197/683/664/original/72076d163e618ce9.png
https://media.snapp.social/media_attachments/files/114/664/660/529/874/101/original/edbadb4b1800e06a.png

2025-06-10 09:16:31 UTC

Interesting conversation with a recruiter at an ex-employer of mine, who are looking to expand their headcount.
They've recently handed back a lease on a building, several years early, and the reasons given were issues with folk hired during the pandemic, and folk switching to hybrid working.
The pandemic one was interesting; Their interview process wasn't remote friendly, but rather than refine, they've decided to revert.
Seems like a signal about their views on remote working 🤔

2025-06-09 16:57:53 UTC

Having to add an explicit dependency declaration to a #gradle build file, to ensure that an app isn't built with a GSON version that has vulnerabilities dating back to 2022, feels sooo wrong..... but hey, that's #AndroidDev!
(if you're wondering, a dependency of the project has a deep transitive dependency on GSON 2.8.9, and Gradle is happily hauling that in to the build with no warnings 😬 )

2025-06-08 10:18:03 UTC

#devops rabbit hole for the weekend; Setting up a dependency analyser for monorepo. Turns out that with the right tools it’s not that difficult, and only costs the price of hosting some docker containers.
The parts of the puzzle are;
https://github.com/CycloneDX/cyclonedx-gradle-plugin
https://github.com/marketplace/actions/upload-bom-to-dependency-track
https://docs.dependencytrack.org/getting-started/deploy-docker/
#security #AndroidDev #Kotlin #java #owasp

2025-06-06 18:13:20 UTC

I’m liking my cats’ approach to starting the weekend.
#SimplePleasures #cats #catsofmastadon
https://media.snapp.social/media_attachments/files/114/637/771/215/208/602/original/63e8c7df33c758a6.mp4

2025-06-06 16:59:39 UTC

- reply

Making your own pillows! 😱

2025-06-05 08:29:53 UTC

Lets see how this stacks up against Slack....
#NextCloud
https://www.youtube.com/watch?v=YtC6bYmS5Iw

2025-06-04 10:13:45 UTC

- reply

Personally I don’t because I leave that fun to Robolectric and AI 🧌

2025-06-03 16:05:40 UTC

- reply

It seems OK, but ask me again in a few weeks :)

2025-06-03 16:05:17 UTC

- reply

Yup

2025-06-03 09:56:14 UTC

Small data point for folk who are playing with the #Mistral Nemo 12b Q4 #AI model.
We're now using it for code reviews at @npub1hnk…syy4, and an m4 mac mini is only 30-40% slower than a 22 core, 256GB Ram, RTX 4000 Ada workstation.
A suitable m4 mac mini costs about half of what the RTX 4000 ada GPU card alone costs.
Mac Mini's seem to be a decent way to get into playing with #LLM usage.

2025-06-02 15:05:03 UTC

I think I’ve answered my own question about whether things could go meaningfully viral on #Mastodon.
https://media.snapp.social/media_attachments/files/114/614/383/419/516/069/original/00cad2673d5f0271.jpeg

2025-06-02 07:03:39 UTC

- reply

I've done some messing around with models over the weekend, and my current preference is mistral-nemo, which is a 12b model, at 4bit quantisation. It's about 20% faster than qwen 2.5 on my machine, and has context window of 128k, so can handle larger diffs.
https://ollama.com/library/mistral-nemo

2025-06-01 11:56:15 UTC

This should be on TV every day, possibly multiple times per day…. #AI
https://media.snapp.social/media_attachments/files/114/607/978/725/543/871/original/f9489651f81bdd9b.mp4

2025-06-01 11:55:23 UTC

- reply

Happy Birthday!

2025-05-31 15:34:44 UTC

- reply

I’ guessing the Claud hardware is high end, so i’d a lot more performant. The “num_ctx” option, which is set in the request the action makes, lets you change the context window, but you bigger windows slow down the review.

2025-05-30 18:24:20 UTC

- reply

I’m sure @npub12yu…k2zm would love another PR from an experienced contributor :)

2025-05-30 18:18:25 UTC

- reply

I’m playing with a few, but at the moment I’m preferring qwen coder 2.5 with 7b params at Q4. I’ve found some larger models generate more wordy responses, but qwen coder 2.5 was more focused on actual issues rather than vague concerns.
Here’s the Action we’re using; https://github.com/ErikHellman/claude-code-reviewer/pull/1

2025-05-30 15:54:57 UTC

- reply

Yup. The CI server is self hosted, and runs ollama locally with the appropriate model available.

2025-05-30 15:04:32 UTC

Today I deployed an #AI backed code review system as part of the @npub1hnk…syy4 #monorepo PR review checks.
Is it going to replace coders? No. Is it throwing up amazing insights? No.
Is it going to catch small things before PRs get opened for human review? Probably.... and that's where I see value. The more things an automated system catches, the fewer things humans have to spend time looking at.
#Dev #DevEx #Coding

2025-05-30 08:33:03 UTC

- reply

You can have so much more fun with naming when they’re walking around with something that essentially resembles a large lollipop 😁

2025-05-30 08:15:35 UTC

- reply

“What if we are the monster?” was such a twist from Rosy. 😮

2025-05-26 21:02:02 UTC

- reply

Gitea / @npub12r3…zz58 use a close compatible GHA language for CI/CD s standard, and have an action runner written in Go.

2025-05-22 08:42:42 UTC

I get mixed feelings when I can create a small reproduction project for an issue caused by a single version bump in a third party dependency. It's nice to know it's not my code, but a fix-release is also out of my control
Today's problem; The compiler in #Kotlin 2.1.20. I've even managed to boil it down to a 1 line change where "2.1.10" works, and "2.1.20" or "2.1.21" triggers the issue.
Anyone at #KotlinConf want to take a look?
https://youtrack.jetbrains.com/issue/KT-77739/Changes-in-compiler-in-2.1.20-causing-compilation-to-fail

2025-05-22 05:10:46 UTC

I’m getting to a point where I’m happy to see a “Do you accept this sites cookies?” prompt on a site 🫠
https://media.snapp.social/media_attachments/files/114/549/761/174/239/623/original/683c567c741eb4aa.jpeg

2025-05-21 19:09:21 UTC

I never thought I’d see the day where China seems to be on a better trajectory, in terms of bringing the world together, than the US. 🤔
https://www.washingtonpost.com/world/2025/05/21/china-who-donation-500-million/?utm_source=reddit.com

2025-05-21 10:48:01 UTC

Place your bets please; Will the #AAOS build for Pixel Tablets become a thing in the #AOSP, or will #Google consider the #Automotive #Android variant a proprietary thing, and not make a non-GAS buildable version of it available for the PT?
Not making an #AOSP buildable #AAOS for the Pixel Tablet would, to me, be a signal of where Google is heading with its new "closed development, then throw it over the wall" AOSP model, and it'd be a sad direction to see them go in.
https://android-developers.googleblog.com/2025/05/android-for-cars-google-io-2025.html?m=1

2025-05-20 10:57:15 UTC

I think someone has a lot of spare tone, money, and energy.
#AI #LLM
https://m.youtube.com/watch?v=7fNYj0EXxMs

2025-05-18 17:39:07 UTC

- reply

I can also recommend the security cameras if you’re in the market for them (I replaced my a Nest setup with them). I’ve just added an AI Port which gives a “dumb” camera face and number plate recognition.

2025-05-14 18:53:10 UTC

Combining this with a text to speech reader would be an interesting thing for sight-challenged folk. https://github.com/ngxson/smolvlm-realtime-webcam

2025-05-10 10:21:30 UTC

- reply

I have a feeling the Swiss connection could be for tax reasons. The history is very US focused.
https://media.snapp.social/media_attachments/files/114/483/035/332/580/047/original/871c38755fb73cc4.jpeg

2025-05-10 08:56:03 UTC

- reply

Garmin is a US Company these days; https://en.m.wikipedia.org/wiki/Garmin

2025-05-08 19:54:15 UTC

Just in case you hadn’t realised the level of remote control folk can gain over a vehicle has already passed the sci-fi conspiracy film level… https://autos.yahoo.com/hackers-discovered-way-remote-control-134700919.html?guccounter=2

2025-05-07 18:21:41 UTC

I wonder how many #automotive headunits will get a #CarPlay update…. https://support.apple.com/en-us/122403

2025-05-06 06:22:00 UTC

Welcome to the work #Android15 #AAOS #LTS
https://android.googlesource.com/platform/manifest/+/refs/tags/android-automotiveos-15.0.0_lts1

2025-05-05 06:25:31 UTC

- reply

Good advice, I’d expect anyone wanting truly private conversations to use a system with E2E encryption, hence my question earlier in the thread.

2025-05-04 14:06:38 UTC

Never underestimate how much unexpected joy folk can get from a shout-out about how you’re using their work.
#android #automotive
#aaos
https://www.linkedin.com/posts/toni-experience-software-gmbh_androidautomotive-khadasvim3-snappautomotive-activity-7324053032097243136-De8X?utm_source=share&utm_medium=member_ios&rcm=ACoAACKv76AB1Z7MWc_8uMWm_Bq20jVFgjieREk

2025-05-04 09:32:20 UTC

- reply

Bit of a repurposing solution, and I know you’ve had a rough time without it recently, but what about Mastodon private, targeted, messages?

2025-05-04 09:03:59 UTC

- reply

Cool. In terms of IM, my main takeaway from being the TL on the Facebook Secret Messages team many years ago, was that browsers are a pretty insecure platform if you’re trying to keep message histories secret due to the access some browser plugins have.
Do you want E2E encryption, or are you happy without it?

2025-05-04 08:49:15 UTC

- reply

I find https://european-alternatives.eu/categories useful for suggestions, and then trying things out to see what works best for me.

2025-05-03 06:20:54 UTC

- reply

https://en.m.wikipedia.org/wiki/Trooping_the_Colour

2025-05-02 16:23:29 UTC

If you vaguely thought the #UK government understood tech… https://uk.lemmy.zip

2025-05-02 12:41:56 UTC

That moment when you get one program (#Jetbrains #Toolbox) that misbehaves in a fundamental way, and the first thought you have is "Oh, I bet they thought they were doing something clever".
FYI; This is #Debian12 with #Nvidia drivers, and this isn't a failing GPU because every other app renders its window fine, and I can drag this around the screen and the pattern remains constant within the window.
https://media.snapp.social/media_attachments/files/114/438/286/742/858/351/original/cd2ab9ad26cd21aa.png

2025-05-01 05:54:55 UTC

There are many folk talking about today being the hottest start to May for the #UK since records began.
It's also worth remembering that "Net Zero" doesn't been back to previous levels, it just means we're not making things worse.
In the #UK the "Net Zero" target is 2050.
That's 25 years of things still getting worse.
25 years.
😬
https://www.bbc.co.uk/news/live/cwy0mwvx04lt
#Climate #ClimateChange

2025-04-30 08:30:40 UTC

- reply

3 is the best approach I’ve seen used anywhere. I think your choice of trade-offs is good.

2025-04-28 14:18:46 UTC

- reply

If anyone else encounters this, it’s because you have the wrong IP address for the server being given to your client 🤦‍♂️ #Debian12 #Debian #OpenSSL

2025-04-28 13:31:45 UTC

Today keeps getting stranger... next on the list, #Google pushing to the #AOSP some repo manifests which require Google Internal SSO authentication;
https://android.googlesource.com/platform/manifest/+/refs/tags/ub-automotive-master-20250418/aosp-master-with-modules.xml

2025-04-28 12:15:38 UTC

Oh this has unexpected fun written all over it....
alsutton@t5810:~$ openssl s_client -connect downloads.snappautomotive.com:443 -servername downloads.snappautomotive.com
CONNECTED(00000003)
401729AACC7F0000:error:0A000438:SSL routines:ssl3_read_bytes:tlsv1 alert internal error:../ssl/record/rec_layer_s3.c:1605:SSL alert number 80
#Debian12 #Debian #OpenSSL

2025-04-28 11:58:13 UTC

A couple of weeks after sorting out the quota issue on #Ionos (50GB hard quota on a 250GB package), but them manually increasing the quota to be, you know, actually 250GB, guess what's happened?
Yup. #Ionos's system has reverted the quota back to 50GB and I'm seeing failed upload messages again.
Time to switch to @npub18s7…wqln

2025-04-25 11:08:12 UTC

- reply

Thanks!

2025-04-25 11:03:57 UTC

- reply

I may get some time to write a GitHub/Forgejo action which we can run on a daily basis and to get regular update PRs.

2025-04-25 08:03:02 UTC

Thanks to @npub1ang…ahch's #gradle version catalogue update plugin, I now have a replacement for #GitHub #Dependatbot, which means we're on feature parity for our #Forgejo instance 🕺 .
Thanks Hugo 🤗
https://github.com/littlerobots/version-catalog-update-plugin

2025-04-21 08:20:30 UTC

Given all the “leaders” of large groups of people that are around at the moment, he seemed like a good guy. https://www.bbc.co.uk/news/live/crknlnzlrzdt

2025-04-20 18:40:08 UTC

I feel sad every time I take folk through the arc of the web being a place where anyone could publish, and popularity was based on how many folk linked to your page because it was interesting, to today, when most folk consume content that’s been promoted using an algorithm that can be tweaked to the interests of a company owner or maximising advertising accenture.

2025-04-18 09:36:39 UTC

I may have found the most pointless dialog box on the entire Internet 🤪
https://media.snapp.social/media_attachments/files/114/358/288/128/321/112/original/5c6a2a20ef2671aa.png

2025-04-17 16:25:21 UTC

- reply

Yeah, I was looking to migrate a bunch of emails using imapcopy, which didn’t have OAuth support :(

2025-04-17 13:55:05 UTC

TIL: As of 14th March, you can no longer use any #POP3 or #IMAP client to access emails held in Google Workspace; https://workspaceupdates.googleblog.com/2023/09/winding-down-google-sync-and-less-secure-apps-support.html

2025-04-14 17:58:44 UTC

- reply

Yup, and our Managed NextCloud membership, which is supposed to include 3TB of storage, is currently stuck at a 15GB quota (so only 5% of the advertised amount)

2025-04-14 08:29:24 UTC

After a week, and conversations with various folk at #Ionos, I have found someone who knows what's going on.
They do, as I suspected, implement "increasing quotas", which means that initially folk are initially provisioned with low quotas, and those are adjusted, in my case, on a daily basis.
So even though the web hosting package is advertised as having 250GB available, the quote limited it to 50GB, then when we hit that increased it to 70GB.
It's now been manually set to 250GB.

2025-04-13 11:11:10 UTC

So #Ionos definitely have some quota provisioning issues.
I've got SSH access to the storage for one of the packages (Web Hosting), and while the package is advertised as offering 250GB, the output of `quota -s -v` shows only 50GB as the quota.
Now all I have to do is get this information into their support org in a way where it lands with the right person.

2025-04-13 09:35:16 UTC

When #Amazon starts showing return information as a part of listings, you know it’s got problems.
https://media.snapp.social/media_attachments/files/114/329/970/992/381/321/original/95f0bdd14c1c51cd.png

2025-04-12 15:24:45 UTC

Is anyone hosting with #Ionos and hitting weird premature quota problems?
I’ve got a couple of separate packages (Managed NextCloud, and simple Web Hosting), and although the Ionos dashboards say there’s 80+% free storage on both, any uploads to either fail with a “quota exceeded” error.
The NextCloud issue was logged with their support on monday and seems to be going nowhere. ☹️

2025-04-12 14:36:44 UTC

- reply

Aren’t those key services that folk consider the “Big Tech” that we need EU solutions for?

2025-04-12 11:10:57 UTC

- reply

Whats the EU/UK alternative to AWS’s range of services?

2025-04-10 05:40:20 UTC

The latest #Android #AOSP security patch marks the end of public Android #12 and #12L security patch support.
There are a number of #Automotive #Infotainment systems based on #Android12 or #Android12L, so it'll be interesting to see whether companies provide updates to #Android13 (or, more likely, #Android14), or whether we see head-units left vulnerable to issues discovered in the coming months and years.
https://source.android.com/docs/security/bulletin/2025-04-01

2025-04-09 08:34:14 UTC

So that’s #LinkedIn losing its ability to post notifications on my devices. 🤦‍♂️
https://media.snapp.social/media_attachments/files/114/307/081/943/781/079/original/31efe3d693d1790a.jpeg

2025-04-08 09:05:03 UTC

- reply

btw, I found this, which might save you some work.
https://www.reddit.com/r/ollama/comments/1j9uxlr/new_google_gemma3_inference_speeds_on_macbook_pro/

2025-04-08 08:54:57 UTC

- reply

on-prem prices can go all over the place. I use workstation cards for local LLMs, and the price of an RTX 4000 (Turing generation) is pretty low.
If you're thinking of buying for on-prem then evaluating Ada Generation cards are worth it due to native support for more formats. The only down side is the stupid-ass power connector on anything higher than a RTX 2000 Ada.

2025-04-08 08:52:19 UTC

- reply

A 4b parameter model at q4 is a pretty small model (~3.3GB), so you're not really pushing limits on either.
At that level you might be seeing some accuracy issues that will need manual intervention, so going Q8 before going for higher parameter counts could be useful.
If you want to see where things differ then the 12b model will start to show things up. The CR instance could even handle 27b @ Q4, which I would expect the mac to struggle with.

2025-04-08 08:23:14 UTC

- reply

To me the test is "Is it generating faster than I can make use of the information (e.g. read it)?".
If you want to speed things up try an 8 bit quantized model (Q8), so that the weights are all 8 bit ints. The Cloud Run GPUs are Nvidia L4's, so if you're using the full precision (FP32, i.e. 32 bit floating point weights), you can speed things up by going to FP16 or even FP8.
The other thing with CR is making sure the model fits into the GPU RAM and doesn't overflow into system RAM.

2025-04-03 16:40:02 UTC

TIL: There is a category of goods in the #UK called "80% Turkeys" :O
https://assets.publishing.service.gov.uk/media/67ee668c9eae202448299c5b/request-for-input-indicative-product-list.pdf

2025-04-03 15:50:06 UTC

One main reason for moving off #GitHub, and other US based infrastructure, is I can see tariffs on internet services becoming a thing that politicians see as possible (again).

2025-04-03 15:47:56 UTC

Moving our git repositories off #GitHub to #Forgejo is proving interesting.
The migration process Forgejo has built-in is really good, but, unfortunately, action runners have a few peculiarities which means a bit of manual fettling is needed.

2025-03-31 13:35:06 UTC

- reply

From my experience it seems a lot of the mainstream folk have moved on to BlueSky, so it tends to be more tech-knowledgeable folk here.
If tech-knowledgeable fits the community, there's a number of fediverse compatible implementations listed at https://www.reddit.com/r/fediverse/comments/1i9bgs8/list_of_fediverse_software/ that focus on different types of media.

2025-03-27 22:06:01 UTC

- reply

Is there a guide others can follow that shows how to keep issues, PRs, etc.?

2025-03-27 09:02:46 UTC

- reply

#define OK 200
what could possibly go wrong? :)