I'm afraid there will be too many corners cut. The most important being the lack of available software. I'm of the notion that a computer without software is nothing more than a box of wires.
https://forums.puri.sm/t/nine-months-librem-5-as-my-only-pho...
https://forums.puri.sm/t/librem-5-phone-review/21085
Concerning the software, I can run most Linux apps and most Android apps with Waydroid. See also: https://linuxphoneapps.org/