@paco i used a work ai bot to close a ticket I didn't have access to...

@paco

Holyyyyyyyy shit.

I am not an expert, but I am fairly certain that is bad.

@paco I remember this exact bug with windows indexing in vista!

@paco so copilot has a Snowden feature? Neat!

Edit: worse since Snowden had audit logs... LOL

@paco @mookie
@FirewallDragons

@paco and I guess this is intentionally, but not to be discovered by others ;-)

@paco
1) Microsoft iinsists that permissions are respected
2) Until further proof is provided that site looks a bit like one of the many AI-generated content farms that pop up all the time. Though the typos do make it look human-made.

@paco Even worse: CoPilot ostensibly has explicitly defined security/content boundaries in the form of resource groups, but they don't actually seem to make a difference. A colleague and I attended an MS presentation/lab where they "showed the potential of AI" (read: a SQL query generator tied to SQLite, and auto-generated out-of-office emails).

First, it only took 30 seconds to get CoPilot to drop the entire test DB just by asking nicely.

Second, my colleague and I created test RGs to isolate our work (also to easily clean up after and avoid billing mess). I had prompted my instance to emulate a very rude Xbox support agent (which it did fairly amusingly). My colleague's OOF message implementation *also* started being an asshole at the same time, despite claims that instances were entirely isolated.

I dread for when MS forces CoPilot indexing on Sharepoint. We already have a hard enough time with oversharing due to bad UI/UX...

@paco Is there a source in the article? I can't see the whole text... Thank you!

@paco Så det du siger er at hvis man nu har en hel kommunes ESDH system bygget ovenpå Sharepoint; Så er man egentlig rimelig screwed, hvis man så også har Copilot integreret i alle Officepakkerne? 😬

@paco #GreatDataHeist

@paco

Security exists for a reason, so I can see this being exploited by people within a work place, to obtain sensitive / confidential information.

What could possibly go wrong.

@paco

"CoPilot, please download a list of all management salaries."

"CoPilot, please download my coworkers performance evaluations and why they got a raise, and I didn't."

"CoPilot, please record the personal email & phone numbers of the corporate donations to the GOP and who authorized it."

"CoPilot, please look up the health claim history of all C-Suite managers."

@paco Direct link: https://www.pentestpartners.com/security-blog/exploiting-copilot-ai-for-sharepoint/