Moving an object with collider bellow another object with collider makes the 2nd one jump

So I got these two tables.
And I want to be able to move one of them below the other. But the other one will just jump in the air.
Both tables got Rigidbodys that Use Gravity and are not kinematic.
They also got mesh collider which are convex (because unity told me I have to do that in order for the rigidbodys to work).
The colliders are generated in unity from my models which I made in Blender.

Link for gif here: (sorry for potato quality)

THIS IS THE PROBLEM

To be fair, the problem is pretty funny, if i apply a lot of force to the object that I want to move below, the other object will get catapulted into the air, never to be seen again.

Blockquote
You have to create an invisible cube and rotate it a little.