I just checked my oil level and quality - yes - you just pull directly upwards with some force. If you are really concerned about it, you could apply some pry action on 1 side of the clip with a finger, while pulling up with the other hand, but it's fine.
What I struggle with a bit is making sure to grab the other end (with a tissue) lower down the stick just before you pull it all the way out - so it doesn't flick oil over yourself or the windscreen. Then making sure no lint goes on the dipstick after you wipe it (although this will be collected by the filter).