You can, but we do not recommend it as an ideal fuel source.
Charcoal will glow like embers but will not promote complete combustion and you'll be left with a lot of leftover ash and mass at the end of your burn. If you are looking for a standby fuel to have on-hand for your CampStove, we recommend wood pellets or wood chips which you can find easily at your local home improvement store. For your BaseCamp, a split piece of firewood works great.