Recently, the multi-tiered storage systems that are composed of hard disk drives (HDDs) and solid state disk drives (SSDs) have received significant attention. The multi-tiered storage system extends the storage hierarchy by using SSDs to cache data from the HDDs. Thus, how to cache the appropriate data on the SSDs becomes an important issue for the multi-tiered storage systems. Due to the tremendous superior access performance of SSDs, current data caching schemes tried to cache the hottest data in SSDs, expecting that all of the disk I/O requests can be served by the SSDs. However, when the disk I/O load is heavy, such a scheme would saturate the bandwidths of SSDs and cause a negative impact on the I/O performance. To address this issue, on the basis of Profit Caching, this paper proposes a new data caching scheme, called Load-Balancing Caching Scheme (LBSC), for multi-tiered storage systems. LBSC takes the instant load of different storage devices for making the caching decision. Specifically, LBSC balance the load of SSDs and HDDs so as to fully exploit both the potential bandwidths of the SSDs and HDDs. We have implemented our scheme in a DiskSim-based multi-tiered storage simulator. From the experimental results, our proposed LBSC data caching scheme can significantly enhance the I/O performance of Profit Caching.