Unable to block access to the O365 Add-In Store on Outlook

[rickjames]

As per the title really!

 

- Access to the store is unchecked on O365

- Checked the Default Role Assignment Policy in Exchange Online and unchecked My ReadWriteMailbox Apps, My Marketplace Apps and My Custom Apps

 

Made the 2nd change nearly 24 hours ago, but when I open up Outlook I can still click Get Add-Ins and download whatever I like.

 

Any ideas where I'm going wrong with this? Because I'm stumped; acquiring Add-Ins elsewhere is disabled and works as it should do...