If your website is not mobile-friendly, you will hurt your visibility.
Common issues facing non-friendly sites are buttons that are too close together, font sizes that are too small and content that doesn’t size right so that people can view it.
If you want to see whether your site is mobile-friendly, go here to run Google’s mobile test.
And, if you want to read about the entire story, visit Google’s page on mobile-friendly sites here.
No matter what, make sure that your site renders well on the mobile device soon.