IT outage

[Iamforreal]

Looks like the IT outage is affecting airports, businesses, banks all over the world, windows computers are shutting down with blue screen errors....we are so reliant on technology that when something like this happens world stands still

[Stevelondon]

But the extra strong technology of UKP keeps the forum running. 

[timsussex]

But the extra strong technology of UKP keeps the forum running. 

ssssshhhhh

Don't tempt the IT Gods

[Adoniron]

Just got back from a hospital appointment. The cafe was cash only due to this (although strangely the other hospital systems seemed to be ok). Lots of millennials and Gen Z's couldn't buy food or drink because they had no cash at all on them. Fortunately dinosaurs like me were OK.

[chrishornx]

at  least it wasn't anything sinister

[MLawro93]

A single mistake can potentially wipe Crowdstrike off the face of the planet.

[mr.bluesky]

But the extra strong technology of UKP keeps the forum running. 

  that's most important 

[Andywb]

Just got back from a hospital appointment. The cafe was cash only due to this (although strangely the other hospital systems seemed to be ok). Lots of millennials and Gen Z's couldn't buy food or drink because they had no cash at all on them. Fortunately dinosaurs like me were OK.

I would probably be cashless if it was not for punting. That's another quality of life bonus arising from our hobby 

[bigden40]

A single mistake can potentially wipe Crowdstrike off the face of the planet.

The sort of mistake that they are paid to avoid

[MrBamboo]

Just came through New Street train station and non of the bar code readers are working so all the gates
Are closed, just one open on the end. If it's like that in a couple of hours it will be chaos..

[myothernameis]

Just as well the IT outage didn't extend to airplanes themselves, especially when the new planes, are computerized 

[scutty brown]

at  least it wasn't anything sinister

How do you know that?
It was an error in an update but how do you know the error wasn't deliberate?

It's also interesting timing in that Azure went down overnight as well, though Microsoft seem to be recovering from that quite well.

One error knocks out access to corporate operating systems, the other blocks access to corporate cloud data storage. Both of which would be key targets in a war.

With my paranoid hat on, it looks like a dry run for a bigger planned attack

[scutty brown]

this is worth a read to give some idea about how difficult this is going to be to recover

External Link/Members Only

the problem is going to be getting remote access to the machines......each machine will have its own bitlocker key and that will need entering manually to get into safe or recovery mode
this is going to be slow and tedious

Take my experience with NHS trusts - the bitlocker keys there were all stored online in AD, no paper records. But if the AD servers are affected by this problem then those keys aren't available. I suspect many other businesses are in the same boat

a couple more posts that give an idea of what's happening and what needs doing

External Link/Members Only
External Link/Members Only

This is the biggest IT outage, ever

[hairdownthere]

How do you know that?
It was an error in an update but how do you know the error wasn't deliberate?

It's also interesting timing in that Azure went down overnight as well, though Microsoft seem to be recovering from that quite well.

One error knocks out access to corporate operating systems, the other blocks access to corporate cloud data storage. Both of which would be key targets in a war.

With my paranoid hat on, it looks like a dry run for a bigger planned attack

Key targets in war are communications, transport infrastructure, energy, fuel and food supplies, not corporate systems.  When a country is at war its corporate world is effectively null and void.

The sharp end of UK Forces (and US at the very least) have their own bespoke operating systems

[hairdownthere]

this is worth a read to give some idea about how difficult this is going to be to recover

External Link/Members Only

the problem is going to be getting remote access to the machines......each machine will have its own bitlocker key and that will need entering manually to get into safe or recovery mode
this is going to be slow and tedious

Take my experience with NHS trusts - the bitlocker keys there were all stored online in AD, no paper records. But if the AD servers are affected by this problem then those keys aren't available. I suspect many other businesses are in the same boat

a couple more posts that give an idea of what's happening and what needs doing

External Link/Members Only
External Link/Members Only

This is the biggest IT outage, ever

Bitlocker keys can be remotely re-configured en-masse as long as the asset IDs are available, something I have to do on an almost daily basis!

[scutty brown]

Bitlocker keys can be remotely re-configured en-masse as long as the asset IDs are available, something I have to do on an almost daily basis!

Yeah, but if the AD servers are down where do you get the list of asset IDs from?

[hairdownthere]

Yeah, but if the AD servers are down where do you get the list of asset IDs from?

The firm I work for have these stored locally

[scutty brown]

The firm I work for have these stored locally

not so easy if you're dealing with an estate numbering in the thousands, which most of the firms affected by this will be. Even worse if a high proportion are used by home / mobile workers

[PumpDump]

Looks like the IT outage is affecting airports, businesses, banks all over the world, windows computers are shutting down with blue screen errors....we are so reliant on technology that when something like this happens world stands still

Let me find the thread where someone was telling me I am an idiot for resisting the cashless society 

[Thephoenix]

Let me find the thread where someone was telling me I am an idiot for resisting the cashless society 

Hilarious early this morning in the posh Waitrose cafe.

Long queue in front of me of ladies in from the  Cheshire set, waiting impatiently to show off their top of the range phones, to pay for their usual 12oz not too hot, 130° split shot, sugar free vanilla, not too much syrup,  no foam, Americano with coconut milk, with big straw.

All having panic attacks as it was cash only.

I wasn't laughing for very long because I'm often stuck behind young'ns paying by phone which isn't working.
I've even got so impatient, I've offered to pay cash for them just to get the queue moving.

Card payment's fine. Phones??....leave them in your bl..dy pocket.
We're not impressed.

All I wanted was a cup of tea and a toasted teacake, so I could sit down and pick my gee gees.

[Xtro]

Key targets in war are communications, transport infrastructure, energy, fuel and food supplies, not corporate systems.  When a country is at war its corporate world is effectively null and void.

The sharp end of UK Forces (and US at the very least) have their own bespoke operating systems

They are the one's making the profits, from both the allies and the enemy.

[southcoastpunter]

They are the one's making the profits, from both the allies and the enemy.

and how do you come to that conclusion for the wider "corporate world"? and makers of armaments would probably not be allowed to suppl the enemy!!!

[lostandfound]

I think this is just growing pains and that IT will become unrecognisably more sophisticated in general in the years ahead, led by AI - which I know is a controversial topic in itself.

I say in general IT is always going to be a challenge for the foreseeable in some organisations like eg the NHS, unless and until IT funding is permanently ring fenced so that it cannot be raided (understandably) for clinical priorities.

Personally, yesterday morning I logged into my bank account and made an electronic funds transfer, and later bought a water in a convenience store by waving my phone at the till, both without issues.

[Iamforreal]

Let's hope after this they will put some backup systems in place(easier said than done), it will definitely happen again, is not a matter of if, but when.

[RandomGuy99]

Let's hope after this they will put some backup systems in place(easier said than done), it will definitely happen again, is not a matter of if, but when.

I think they need to look at how they released the update. They seemingly blindly released it without any checking that it wasn't causing issues and it rippled throughout the world. If the backup systems were also protected by Crowdstrike they would also be taken out unless they kep the backup systems on the previous working release until the new release was proven not to break anything.

[8MillionDollarMan]

I think they need to look at how they released the update. They seemingly blindly released it without any checking that it wasn't causing issues and it rippled throughout the world. If the backup systems were also protected by Crowdstrike they would also be taken out unless they kep the backup systems on the previous working release until the new release was proven not to break anything.

  never ceases to amaze me when "updates" are released that simply don't work or work worse than before because they haven't been tested.

[mr.bluesky]

Will Crowdstrike be liable for compensation claims. With the worldwide disruption they have caused in Banking, retail and flight/ holiday cancellations surely it would run into billions 

[scutty brown]

Will Crowdstrike be liable for compensation claims. With the worldwide disruption they have caused in Banking, retail and flight/ holiday cancellations surely it would run into billions 

Possibly, it will depend on what get-outs are in the contracts, and where the contracts were located legally........I suspect most will come under Delaware jurisdiction which does tend to limit liabilities.
But one thing is for sure - I wouldn't want to be an insurance underwriter right now. This is going to be a headache for Lloyds

The insurance companies are going to be on the hook either way: either by covering the individual costs and losses directly,  or by covering the compensation  payouts resulting from any court action. It could seriously dent global insurance.

[hairdownthere]

not so easy if you're dealing with an estate numbering in the thousands, which most of the firms affected by this will be. Even worse if a high proportion are used by home / mobile workers

We're running with around 2.3k users, we were able to get a communication out via disaster recovery channels not log in, reckon we had less than 10% of assets affected which we managed to re-config today.  Could have been a lot worse for us!

[scutty brown]

We're running with around 2.3k users, we were able to get a communication out via disaster recovery channels not log in, reckon we had less than 10% of assets affected which we managed to re-config today.  Could have been a lot worse for us!

you were lucky on that one
good that you had the users trained to read messages - and act on them

[Adoniron]

Possibly, it will depend on what get-outs are in the contracts, and where the contracts were located legally........I suspect most will come under Delaware jurisdiction which does tend to limit liabilities.
But one thing is for sure - I wouldn't want to be an insurance underwriter right now. This is going to be a headache for Lloyds

The insurance companies are going to be on the hook either way: either by covering the individual costs and losses directly,  or by covering the compensation  payouts resulting from any court action. It could seriously dent global insurance.

I would expect a lot of the consequential loss claims (loss of profit etc) to be excluded entirely by the policy wording or for the level of indemnity to be limited.

[Xtro]

and how do you come to that conclusion for the wider "corporate world"? and makers of armaments would probably not be allowed to suppl the enemy!!!

Going by what has happened in the past, especially WWII.

[southcoastpunter]

Going by what has happened in the past, especially WWII.

WW2 was over 80 years ago - and which companies were supplying Germany or Japan during 1939-45 or otherwise able to make profits from them? Obviously in times of war, certain types of companies are going to see demand soar.

[Xtro]

WW2 was over 80 years ago - and which companies were supplying Germany or Japan during 1939-45 or otherwise able to make profits from them? Obviously in times of war, certain types of companies are going to see demand soar.

Search something like "Companies that benefited from WW2". American IG probably the most infamous.
As well as insurance companies and banks.
Date has nothing to do with it. Corporations still go to great lengths nowadays to maximise profits. They have no morals.

[daviemac]

Search something like "Companies that benefited from WW2". American IG probably the most infamous.
As well as insurance companies and banks.
Date has nothing to do with it. Corporations still go to great lengths nowadays to maximise profits. They have no morals.

What has WWII got to do with this thread? CrowdStrike, the cause of the IT issues, wasn't founded until 66 years after it ended. 

[Stevelondon]

On a personal level. I’ll not get involved in the why’s and wherefores of what happened that day.
I had taken cash out of the hole in the wall the day before. But actually just the exact amount I assumed I would be needing for a punt the following day.

So going to the pub around midday and ordering a drink with a little snack……….. could not accept my card so I had to use some of my punting money.
WTF !!!!

Heading off to an ATM machine afterwards and finding it and otters nearby were all out of service. I had to join a bloody queue inside the bank to withdraw some more money.
Can’t remember the last time I ever did that and I did not enjoy it one bit.

Note to self…………… always have at least a thousand pounds (hard cash) in the home safe at any given time.
Just in case. 

[Xtro]

What has WWII got to do with this thread? CrowdStrike, the cause of the IT issues, wasn't founded until 66 years after it ended. 

Apologies    

[ZeroCount]

Heading off to an ATM machine afterwards and finding it and otters nearby were all out of service.

As if the broken cash machine wasn't bad enough, you had to put up with malfunctioning otters. What a day!

[kingmg]

Looks like the IT outage is affecting airports, businesses, banks all over the world, windows computers are shutting down with blue screen errors....we are so reliant on technology that when something like this happens world stands still

as long as adultwork, vivastreet, uk p and porn hub is not down life is great

[mr.bluesky]

Note to self…………… always have at least a thousand pounds (hard cash) in the home safe at any given time.
Just in case. 

Not posh enough  for a home safe so I just continue to stuff it under the mattress or floor boards 

[akauya]

Not posh enough  for a home safe so I just continue to stuff it under the mattress or floor boards 

That and some of these too 


Hidden Image/Members Only

[mr.bluesky]

That and some of these too 


Hidden Image/Members Only

I'd love to know how you'd fit a passport in one of those tins 

[daviemac]

I'd love to know how you'd fit a passport in one of those tins 

Would stand out like a sore thumb in amongst a shelf full of Aldi beans.