The change is part of a new law that went into effect July 1.
The new law means anyone who can legally own a gun can carry it anywhere and that has some concerned.
"It does cause a scene and we do get calls from time to time," said Atchison County Sheriff Jack Laurie. "Somebody having a gun on their side as as their pumping gas or they're going to the gas station with a gun on their hip which it is a concern"
Several businesses in Atchison, including Van Dyke's grocery store, say seeing a person carry a gun into a store may make others feel uncomfortable.
Kyle Van Dyke says he doesn't want his customers to leave because of the law.
"If a family's coming in, and they see a guy or two guys coming in with guns on their hips, they might think twice about coming in my business and that's something that we don't want," said Van Dyke.
Businesses do have the right to keep people from bringing in guns by posting a sign saying guns are not allowed.
City officials say keeping the public safe when it comes to guns is their number one goal.
"They're not toys, said Laurie. "I hope everybody would understand that there are safety issues when it comes to any type of weapon but these guns need to be in a holster, they need to be secured and if they're not it's going to cause issues."
The Atchison County Sheriff's Department plans to provide signs for business owners who don't want to allow guns.
Copyright 2016 Nexstar Broadcasting, Inc. All rights reserved. This material may not be published, broadcast, rewritten, or redistributed.