Ezra 4:4–5 (ESV)

4 Then the people of the land discouraged the people of Judah and made them afraid to build

Opposition to the Jews and their desire to worship God was seen in the actions of these people living around them. Their actions confirmed the fact that they were enemies. They made the people afraid, the bribed Persian officials to work against them. They did this for a long time, even from the beginning of the return from Babylon. As a result of this opposition, the work of rebuilding the temple came to a quick stop after it began (Ezra 4:24).