如何创建一个类标签来用java构建广播变量spark？

Question

我需要在我的 JAVA 函数中创建一个 borodcast，一个字符串列表的广播Broadcast<List<String>>broadcastSp = sc.broadcast(Tvalue,classTag<T>evidence);T 值是 "my_list" ( List<String>)，但问题是如何创建第二部分classTag<T>evidence.

Answer 1

这是我的功能：

public static JavaSparkContext sc;

public static Broadcast < List < String >> broadcastP;

public static void main(String args[]) throws Exception {

    sc = new JavaSparkContext("local", "test");

    .

    .

    .

    private static List < String > fFtItemSets(JavaRDD < String > base_initiale) throws Exception {

      List < String > kMinusOneSets;

      List < String > k_sets;

      int i = 1;

      k_sets = remplir_ksets_intiale(base_initiale);

      System.out.println(k_sets);

      List < String > k_sets1 = k_sets;

      int NB = k_sets.size();

      while (NB > 1) {

        kMinusOneSets = k_sets;

        k_sets = Jointure(kMinusOneSets);

        k_sets = Elagage(k_sets, k_sets1, i);

        System.out.println(k_sets);

        Broadcast < List < String >> broadcastSp = sc.broadcast(k - sets, List < String > );

        //main.sc.broadcast(k_sets);

        System.out.println(broadcastSp.value());

        k_sets = tr_freq(k_sets, broadcastnSp, base_initiale, i);

        k_sets1 = k_sets;

        NB++;

        i++;

      }

      return k_sets;

    }