系统托盘应用程序和内存占用

I have created a small application that, basically, exists in the system tray and the user only needs to open the actual application in VERY few cases. The problem is, that once the suer opened the application for the first time, the memory is filled up with an awful lot of data (WPF UI for datagrids, treeviews etc). But then the user will minimise the application again and it will sit there for most of the time. The only UI that is always accessible is the tray icon's contextmenu.I have created a small application that, basica