Solar drying is one of the most important processes of preserving agricultural products. This review paper focused mainly on the enhancement of efficiency a solar drying system. The establishment of different techniques and factors, which may affect the performance of solar dryers, helps to improve solar dryers’ effectiveness. Different types of solar dryers were described here; moreover, various performance analyses of solar drying systems (SDSs) were presented. Factors and techniques for improving efficiency of solar dryers were discussed as well. The effect of operating conditions, geometrical conditions, adding of reflectors, heat exchanger, heat pump, photovoltaic source, air circulation mode, and phase change material (PCM) on the efficiency of a solar drying system were studied and discussed. Results showed that climatic conditions such as ambient temperature and solar radiation have an important influence on the solar dryer performance. The chimney integrated in solar dryer increases the buoyant force applied on the air stream to maintain a greater air flow velocity, which removes one side of moisture. The concentrators found to be effective in reducing the drying time by increasing the air temperature inside the dryer. Photovoltaic panels provides electricity source to run electrical components such as the fan to provide a forced air circulation that removes more moisture from the product compared with the natural convection or the heat pump to ensure the drying process at night. PCMs store the thermal energy during sunshine hours and release it after sunset, which can reduce the heat losses and improve the thermal efficiency of the drying system.