This museum is a rather small museum with only one exhibition at a time. Usually, tourists are the main visitors of Paris museums. Surprisingly, they don't respect tourists too much, all written information and guided tours are only in French. However, there is a QR code where you can get a really short test on your phone in English to take the next step.
When you get your ticket, there is no information indicating that this is a French-only exhibition. So, if you don't speak fluent French, don't come to this museum. By the way, the elegant cafe at the door is expensive and the cakes are very small.