It's good practice to download updated version. Inbuilt update functionality a time-saving function. However, due to some inevitable circumstances update process get stuck. In this time, it's better to download a fresh version. Following are the two most reliable sources to download Bluestack and many other utilities.
You do not need to remove an old version. Just install version, it will automatically update/replace the old one.