1. Do I need to keep Eavescrob running?
No, you don't even have to open the app. Eavescrob will compile your listening history on startup, so it only works with the stock Music app and some other apps that play music from system library. Please notice that a song can only be added to your listening history by being completely played, you can drag the scrubber to the end instead of skipping as a workaround.
2. Does it work with Apple Music streaming?
Partially. Only songs that have been added to 'My Music' will show up in the listening history.
3. Login always fails
Make sure to log in by username instead of email address. Also in some edge cases the mobile API of Last.fm doesn't handle login properly. If you do encounter this rare problem, try changing your password on Last.fm then you should be able to log in. Sorry for the inconvinience.
4. Why my repeated plays are timestamped at one single time point?
Due to the limitation of iOS system, iOS only keeps the last time point of a song you've played, so currently the repeated plays are timestamped based on your last played date. Let's hope a better solution would come to iOS eventually.
5. Lots of pending scrobbles that I didn't listened on my phone appeared after syncing with iTunes.
Again, this is inevitable because syncing with iTunes includes listening history. So if you use an separate scrobbler with iTunes on your computer, I recommend you submit your pendings in Eavescrob first, then after syncing, you can delete all redundant pendings in Eavescrob by pressing 'Edit' -> 'Mark All' -> 'Delete'.