Make the dough. Mix the flour, sugar, baking powder, salt, cinnamon, allspice, and cloves in a medium bowl. Then, put in the eggs, milk, and vegetable oil. Stir until everything is mixed. Don't forget to scrape down the bottom of the bowl to make sure all the dry ingredients are mixed in. Gently mix in the diced apples until they are spread out evenly in the dough.
Scoop and fry. Heat 1¼ inches of peanut oil in a heavy skillet, Dutch oven, or deep fryer to 375°F (190°C). Drop the dough into the hot oil using 2-tablespoon-sized amounts. Cook each side until deep golden brown, flipping after 2-3 minutes. Work in batches to avoid overcrowding the pan.
Drain. Using tongs or a strainer, remove the fritters and place them on paper towels to drain excess oil.
Make the glaze and dip. In a small mixing bowl, whisk together the confectioner's sugar, vanilla extract, and milk or cream until smooth. Individually dip each fritter in the glaze, then place on a cooling rack until the glaze hardens.