I have been able to negate some round corners by creating a ~/.config/gtk-3.0.css with the following text:
headerbar, .titlebar, .csd menu {
border-radius: 0px;
}
For example Budgie Control Center now has straight corners, but Budgie Desktop Settings still has round corners.
PS: I'm using Materia Widget theme.