Inorganic describes a broad chemical classification. Mineral materials and many salts are inorganic; the term does not mean harmless, sterile or suitable for every cleaning method.
What this means at your property
A white deposit on masonry may contain mineral salts, while another pale residue may have a different source. Appearance alone cannot identify the chemistry or establish which product will remove it without damaging the finish.
What is useful before cleaning an unknown deposit?
Record the substrate, moisture history and previous treatments. Ask for identification or a suitable assessment before choosing a cleaner, and have any proposed method evaluated for compatibility with the actual surface.