> At the same time, the press service states that some of the staff will continue to have access to a special platform for AI assistants, which the Government Offices themselves developed, and through which they gain access to ChatGPT and Claude.
Sounds like they just want to maintain control over the outbound traffic which sounds rather sensible to me.
It is part of the trend to locally-hosted AI. I demoed my home rig (3x5060s) to my boss last week. It certainly was not as performant as commercial options, but was well above the 90% solution for what we needed. The boss was shocked at the price points for home-built hardware. Gaming GPUs are pricy, but are nowhere near the prices for commercial (rack-mount) compute hardware.
(People actually came by my desk to see "the AI", the physical thing. It blows people's minds to realize AI doesn't need a data center, that it is just some computer parts sitting on a desk.)
The big hitter AI companies see the writing on the wall: open source models and local AI rigs will decimate the market for big AI in the next few years.
I see this as the eventually end game. Open source models and local hardware are going to be the only path forward for companies as the AI providers move to a constant need to increase prices to drive profitability and stock price.
I don't think it will be the moment nvidia decide there's more money to be made in selling hardware for local-first inference. They'll do the training themselves and give the models away for free, like the toy in a box of cornflakes.
I'm sure cloud models will always have a slight edge but most tasks, most of the time, won't need that few extra percentage points of performance.
>> out of reach financially and technically for most people
Yes and no. I bought most of the hardware before the rampocalypse. It is just an AM4 chip on a nothing motherboard. Even today, 16GB 5060s are maybe 500 each. 64GB of DDR4 is another 500$. Add a power supply and pci risers and the basic parts could be purchased today for around 3000$... call it 4000$ all-in including my labor to get everything connected and talking to each other.
4000$ is money but is also almost nothing in the world of commercial IT purchases.
What a complete nonstory. Even at my 50 person startup we have an IT policy that requires employees to only use approved AI tools. For a government the only real news is that there wasn't already something in place enforcing this.
This seems to be because of sensitive data and auditing, not just contacts.
> The risks of unregulated AI use have been noted within a number of authorities where there has also been reason to take other measures.
> Among them is the Swedish Transport Administration, where the internal audit earlier this year discovered widespread and risky use of about ten different AI services and wrote as follows:
> "We have seen several examples of problematic use of open AI services. The examples concern both the sensitivity of the information entered and how the AI-generated responses have been handled."
> Some staff will continue to have access to a dedicated platform for AI assistants—developed in-house by the Government Offices—which provides access to ChatGPT and Claude.
> Internal information also indicates that, following a review, security measures for the approved tool Copilot have been strengthened. However, the press office has declined to provide details regarding these enhancements, citing security considerations.
I think some good background for this is also that Skatteverket ("Swedish IRS") has made headlines recently for allowing wide usage of Azure within its IT-infrastructure. Seemingly with very little investigation into the abysmal privacy/integrity/confidentiality posture of US-based cloud services.
I would suspect those headlines caused public officials to investigate how the public sector employees actually use AI chatbots.
This seems to only be for a few of the offices as well. A famous project (at least in Swedish news) earlier this year introduced airgapped Kimi-based models for usage, but it got paused.
That is likely the case. Microsoft is shoving Copilot down everyones throat, whether they want it or not. The sales argument is always: "Why pay for another license if it's already included in O365?" Plus the fact that some data protection contract is already negotiated to be able to use O365 for email.
In the end, if employees are dissatisfied with Copilot, blocking Anthropic and OpenAI will just make people switch to their personal devices and use those services on their smartphones if necessary.
You are forgetting something very important. Microsoft has a much better track record of data policies being correctly enforced. Neither OpenAi or Anthropic have that.
It's not about the model or who gets the bribe, like a few folks in this thread imply, it's simply the guarantees that Microsoft is able to give to a public institution about what happens to their data.
> Microsoft is shoving Copilot down everyones throat
Of the three, I would rank Microsoft as less risky with data handling. Even if the other two are better products, I can see how data control is an important consideration in government. Of course, best is if they operate a fully controlled platform; that may yet be their endpoint.
That's why they backpedal on screenshoting entire screen, keeping images on device and feeding them to LLM? Yeah, for me all of them have 0% trust. Malware used to need to be installed, not part of OS
Just a reminder: Last year, the email address of the prosecutor of the International Criminal Court (ICC) was suspended. Karim Khan couldn’t access his Microsoft account and had to move to Proton Mail.
> Plus the fact that some data protection contract is already negotiated to be able to use O365 for email.
This is most likely the key thing. At least here in Europe, already having the processor agreements set up - and Microsoft actually at least trying to do the bare minimum regarding compliance - is worth a lot, even for a nominally inferior product.
Bit dramatic headline. Every it department or whomever governs data on earth doing it's job is at least thinking of how the organization uses ai. What data it is fed, cost, what actions it can take.
Limiting the amount of tools sounds like a sane default in most cases.
Nothing in this necessarily say anything about one of the tools doing a better job than the other in this regard. It might say a little bit about trust though, warranted or not.
History will spend a lot of time exploring how the two front runners of AI mismanaged their rep and eroded public trust so severely that people rejected their transformative technology.
It's not ideal, but governments already use MS products on a large scale. Quite some are cloud-based these days. And they are an established corpo that is doing well financially compared to pure model operator that might be broken up the day after tomorrow for spare parts by their investors and creditors, which put the confidentiality of the conversation logs into jeopardy.
On the one hand, it makes sense to focus on few whitelisted providers with whom there are explicit confidentiality agreements.
On the other hand, the simplest explanation is that the Microsoft grip on those government agencies is strong and with them already exclusively using the Microsoft ecosystem like all swedish public employers are (including universities), it's only the natural next step to strongarm them into using exclusively their AI offering as well.
We have this discussion with some public customers who want to use LLMs in our products. So far there is no official policy for the public sector so we are telling them to bring their own LLM model either by deploying models to azure in the region they want thus sifting the responsibility onto their contract with Microsoft and off our plate or sign a contract where they acknowledge they understand the risks of using third party llms (we offer, open ai, claude and mistral as providers for now).
Why would you need “AI” in a government office to begin with? Companies are heavily invested in it because of FOMO, but what are they getting from “AI” that’s so essential?
Make no mistake, using AI can be quite helpful and sometimes is necessary. What I mean by “AI” is the way Big Tech packages and sells every kind of automation.
Sounds like they just want to maintain control over the outbound traffic which sounds rather sensible to me.
Yeah, and probably also forcing Zero Data Retention contracts on those service, instead of the consumer variants.
(People actually came by my desk to see "the AI", the physical thing. It blows people's minds to realize AI doesn't need a data center, that it is just some computer parts sitting on a desk.)
The big hitter AI companies see the writing on the wall: open source models and local AI rigs will decimate the market for big AI in the next few years.
I'm sure cloud models will always have a slight edge but most tasks, most of the time, won't need that few extra percentage points of performance.
Yes and no. I bought most of the hardware before the rampocalypse. It is just an AM4 chip on a nothing motherboard. Even today, 16GB 5060s are maybe 500 each. 64GB of DDR4 is another 500$. Add a power supply and pci risers and the basic parts could be purchased today for around 3000$... call it 4000$ all-in including my labor to get everything connected and talking to each other.
4000$ is money but is also almost nothing in the world of commercial IT purchases.
> The risks of unregulated AI use have been noted within a number of authorities where there has also been reason to take other measures.
> Among them is the Swedish Transport Administration, where the internal audit earlier this year discovered widespread and risky use of about ten different AI services and wrote as follows:
> "We have seen several examples of problematic use of open AI services. The examples concern both the sensitivity of the information entered and how the AI-generated responses have been handled."
> Some staff will continue to have access to a dedicated platform for AI assistants—developed in-house by the Government Offices—which provides access to ChatGPT and Claude.
> Internal information also indicates that, following a review, security measures for the approved tool Copilot have been strengthened. However, the press office has declined to provide details regarding these enhancements, citing security considerations.
I would suspect those headlines caused public officials to investigate how the public sector employees actually use AI chatbots.
https://code.claude.com/docs/en/gateways
Seems like a good way to govern usage to an alternate model provider
In the end, if employees are dissatisfied with Copilot, blocking Anthropic and OpenAI will just make people switch to their personal devices and use those services on their smartphones if necessary.
It's not about the model or who gets the bribe, like a few folks in this thread imply, it's simply the guarantees that Microsoft is able to give to a public institution about what happens to their data.
This is most likely the key thing. At least here in Europe, already having the processor agreements set up - and Microsoft actually at least trying to do the bare minimum regarding compliance - is worth a lot, even for a nominally inferior product.
Limiting the amount of tools sounds like a sane default in most cases.
Nothing in this necessarily say anything about one of the tools doing a better job than the other in this regard. It might say a little bit about trust though, warranted or not.
Some of my favorites: https://forums.macrumors.com/threads/apples-new-thing-ipod.5...
Thanks for this
But then the story goes on and say MS Copilot is an approved AI... Sad thing to read.
On the other hand, the simplest explanation is that the Microsoft grip on those government agencies is strong and with them already exclusively using the Microsoft ecosystem like all swedish public employers are (including universities), it's only the natural next step to strongarm them into using exclusively their AI offering as well.
Make no mistake, using AI can be quite helpful and sometimes is necessary. What I mean by “AI” is the way Big Tech packages and sells every kind of automation.
Meh