Do you really need HTTPS between cloudflare and your server?

Out of habit, I keep adding let's encrypt to my server that is already behind a cloudflare proxy. I feel like the number of times I have to sufer through connection issues do not justify the need to add https between my server and cloudflare plus doesn't that add a lot of overhead? makes me unsettled.