In a large mixing bowl, beat the softened butter and granulated sugar together for 2 to 3 minutes until light and smooth. Beat in the egg and vanilla extract until fully combined, scraping down the bowl as needed.
In a separate bowl, whisk together the all-purpose flour, matcha powder, baking powder, and fine salt until evenly mixed and no matcha lumps remain.
Add the dry ingredients to the butter mixture in two additions, mixing on low speed just until a dough starts to form. Add the milk and mix briefly until the dough comes together into a soft but not sticky mass.
Divide the dough into two equal portions and flatten each into a disk. Wrap both disks well and chill them in the refrigerator for 30 minutes so the dough firms up for rolling and cutting.
Preheat the oven to 175°C and line two baking sheets with parchment paper. Lightly flour a work surface and roll out one disk of dough to about 6 millimeters thick.
Use a Christmas tree cookie cutter to cut as many cookies as possible, then transfer them to the prepared baking sheets, spacing them about 2.5 centimeters apart. Gather and reroll scraps once, then cut more trees. Repeat with the second dough disk.
From a small portion of the rolled dough or from rerolled scraps, use a tiny star cutter to cut 24 small stars that will sit on top of the trees. If the stars soften too much while cutting, place them in the refrigerator for 5 minutes before baking.
Bake the cookies for 10 to 12 minutes, rotating the pans halfway through, until the edges are set and the tops look dry. The matcha cookies should stay green, so avoid letting them brown deeply. Cool on the baking sheets for 5 minutes, then transfer to a wire rack to cool completely.
To make the yuzu icing, whisk the powdered sugar, yuzu zest, and yuzu juice together in a small bowl until smooth and thick but pipeable. Add the water a few drops at a time only if needed to loosen the icing slightly.
Spread or pipe a small dab of yuzu icing onto each star and attach one star to the top of each cooled tree cookie. Let the icing set for about 20 minutes before serving or packing the cookies.