Statistics is the scientific study of collecting, organizing, analyzing, and interpreting data. It involves descriptive statistics, which describe characteristics of a data set, and inferential statistics, which are used to infer properties of a population based on a sample. Key concepts in statistics include populations, samples, parameters, statistics, quantitative and qualitative data, variables, and levels of measurement. Determining appropriate sample sizes relies on techniques like Slovin's formula. Sampling can be done through probability or non-probability methods, with simple random sampling, systematic sampling, cluster sampling, and stratified random sampling falling under probability sampling.