I wish it was more simple.
The official matrix.org server is completely stripped down and removes a lot of features, and Element as a client is nowhere near as good as anything else.
Element X (with the sliding sync support) does fix the massive issue of absolutely horrifically slow syncing.
None of Matrix comes anywhere near the levels of usability Discord has and nor does Element, Discord's server-chat model is unbeatable in this aspect.
It's quite a massive change and significantly impacts usability in a lot of cases and it also makes Discord no different from any other app.
If they had just kept the server list in the direct messages view this would've been way less worse.