Load balancing is the key to the efficient operation of distributed systems. To efficiently utilize computing resources provided by distributed systems, an underlying Dynamic load balancing (DLB) scheme must address both heterogeneous and dynamic features of distributed systems. In this paper, a DLB scheme for Solution Adaptive Finite Element Graph Applications on distributed systems is proposed. Experiments show that by using the proposed distributed DLB scheme which considers the heterogeneous and dynamic features of distributed systems, the execution time and the number of process migration is close to using Condensed Binary Tree Load Balancing (CBTLB) scheme which does not consider the heterogeneous and dynamic features of distributed systems.