Let's face it and narrow the possibility down to who Gomu Gomu no mi might be or might not belong to previously.
Firstly let's lay some ideas about why is this particular fruit is important. We know for a fact Shanks had it and it was stolen from the world Government. So, that implies that it was important to the world government. Ok so, if the government had it in its original form(fruit form) that means either the world government "killed" someone and got it after that person died or it was recently found and had no previous owner.
Gol D. Roger was killed by the government*
Ace's mother died and the government might have hands-on it afterwords*
Luffy's mother could have been the previous owner and Garp might have given it to the Navy to store it for Luffy after Luffy decides to join Navy*
Or it has an important history related to the Void country*
Joy-Boy could have been the previous owner*
['Note: please leave comment about this topic and comment what else is this topic is missing]*