Compact View -- Refresh should bring user back to compact view

Currently clicking refresh seem to bring user back to the large view (default) 

Either make it such that the view is not affected by refresh or change the compact view to the default view?