We investigate the consequences of the Mach's principle of inertia within the context of the Dual Phase Space Relativity which is compatible with the Eddington-Dirac large numbers coincidences and may provide with a physical reason behind the observed anomalous Pioneer acceleration and a solution to the riddle of the cosmological constant problem. The cosmological implications of Non-Archimedean Geometry by assigning an upper impossible scale in Nature and the cosmological variations of the fundamental constants are also discussed. We study the corrections to Newtonian dynamics resulting from the Dual Phase Space Relativity by analyzing the behavior of a test particle in a modified Schwarzschild geometry (due to the the effects of the maximal acceleration) that leads in the weak-field approximation to essential modifications of the Newtonian dynamics and to violations of the equivalence principle. Finally we follow another avenue and find modified Newtonian dynamics induced by the Yang's Noncommutative Spacetime algebra involving a lower and upper scale in Nature.