Here's what it looks like on good capacitors. First is a low ESR Rubycon 10uF. Second is a cheap-o 10uF. You can see how a little bit of ESR manfests as a constant voltage offset, making it more jagged. The third trace is a 1000uF low ESR Nichicon. Because the cap is so large, you basically get a flat line.
I'm not totally sure what's going on with the switching transients here, but I did not have a solid ground connection to the scope, so maybe it's just that.