Do you mean (5:21-24)? The translation above is fine. In fact the word translated as giant جبار is not a word that specifically means giant. It s means mighty, powerful, tyrannical, The one who forces... and it is in fact one of the names of God al-Jabbar and there is an American basketball player called Abdul-Jabbar.
So it is by no means certain it means giant. Which is kinda why I originally asked the question about the Bible, since the Qur'an often plagiarises the Bible and so if the Bible says giants then that is probably what the Qur'an meant. As I say the classical tafseers certainly thought so.
There are views in Judaism which take the stance of sons of nobility, power, might, etc. One dates back to 70 CE I think.