With the development of society and the progress of technology, mobile video surveillance system plays a more and more important role in social life and industry production. Mobile video surveillance system is consisted of server-side and client-side. The design of client-side is focused on. Through the analysis on the actual demand from current video surveillance user monitoring video screen at anytime and anywhere, by taking the combination of IP network and the wireless network as transmission network, J2ME as the main programming language, the MVC pattern as the main frame of software, the 3GP is used as the main packaging formats to encapsulate H.264 video data, A schematic design of client-side for mobile video surveillance system is proposed. The architecture and module functions are briefly introduced; the design idea of core function modules is also given. Based on the communication instruction, video data transmission, and the software design, the functions involving a user login, adding, modifying, and deleting device information, PTZ control, channel selection, keep alive, operation assistance, viewing monitor screen and others are achieved, the general demands of ordinary users is basically met. The solution could be used to other platforms due to its universality.