Hey Uke671, welcome to the forum!
I had (and still do to some extent) trouble with this for a while too. Practice will pay off, it just takes a while sometimes. The first times I tried this, I could not get my pinky to drop like I wanted, so I moved on to something else (there's ALWAYS something else) for a while, then came back to it and found it a little easier each time, so I'm making progress and you will too I'm sure.
When it starts to feel like a chore, and not 'fun' anymore, that's the time to move on for the time being. I'll also jump around to things that I've learned well enough to get a little confidence back and re-attempt as well. Your 'cycle' will differ I'm sure, but this little rotation works okay for me.
Above all, have fun!