Using "back to: category" button goes back to "first" page of that categoery

[Kevin Minion]

Hi,

When you are in the shop, click for a category, click for a product, you get a list of products. The number of products is set by yourself. When you have multiple pages and you were on the (for example) 4th page and you see a product you like. So click the product and then you think, no itś not the one I was looking for. You can you use the "back to: category name" but it will jump to the first page of that category while you were already on page 4.

Anyone an idea to solve, so the "back to category" will back to the page 4?
Using the backspace on your keyboard will do this by the way but not every customer is that nerdy

VM 2.6.0a
PHP5.5.9
MySQL 5.5.35

/J