| BML-S | Help Login

Last entries

    20181214.0721
  1. spark|spark-sql|hive > Caused by: java.lang.NumberFormatException: For input string: "0012050_0000" - [s]

    https://issues.apache.org/jira/browse/SPARK-15348 : Hive ACID (support) https://issues.apache.org/jira/browse/SPARK-16996 : Hive ACID delta files not seen spark.conf.set("hive.transactional.table.scan", "true") spark.conf.set("schema.evolution.columns","key,value") spark.conf.set("schema.evolution.columns.types", "int,int")

  2. 20181211.1056
  3. how to set spark.sql.thriftServer.incrementalCollect=true - Stack Overflow - [s]

  4. 20181210.1726
  5. hadoop - Plain authentication failed: User yarn is not configured for any impersonation. impersonationUser: root in alluxio mapreduce - Stack Overflow - [s]

    alluxio.master.security.impersonation.root.users=* alluxio.master.security.impersonation.root.groups=* alluxio.master.security.impersonation.client.users=* alluxio.master.security.impersonation.client.groups=* alluxio.security.login.impersonation.username=none

  6. 20181207.1549
  7. Ranger permissions to create temporary function (set * in database) - [s]

  8. 20181207.0939
  9. Installing Older Versions of Cloudera Manager 5 | 5.5.x - [s]

    #How to download old/older/archived java. Get link from the browser then: curl -o jdk-8u161-linux-x64.rpm https://download.oracle.com/otn/java/jdk/8u161-b12/2f38c3b165be4555a1fa6e98c45e0808/jdk-8u161-linux-x64.rpm?AuthParam=xxxxxx # vim /etc/yum.repos.d/cloudera-manager.repo [cloudera-manager] name = Cloudera Manager, Version 5.10.1 baseurl = https://archive.cloudera.com/cm5/redhat/7/x86_64/cm/5.10.1/ gpgkey = https://archive.cloudera.com/redhat/cdh/RPM-GPG-KEY-cloudera gpgcheck = 0 yum install cloudera-manager-daemons cloudera-manager-server cloudera-manager-server-db-2 service cloudera-scm-server-db start service cloudera-scm-server start

    20181217.0936
  1. python2|python3 > URL query parameters to dict python - [s]

    python -c 'import os try: from urllib import parse except ImportError: import urlparse as parse url = os.environ["SHELLINABOX_URL"] result = parse.parse_qs(parse.urlsplit(url).query) print(result) '

  2. 20181214.1336
  3. html|javascript > How to display Base64 images in HTML? - [s]

    # Also how to generate from copy and paste of clipboard: https://gist.github.com/STRd6/5286415

  4. 20181214.1314
  5. Better Markdown Parser in PHP - [s]

    https://github.com/erusev/parsedown/blob/master/Parsedown.php

  6. 20181214.1313
  7. php > How To Install and Use Composer on Ubuntu 18.04 - [s]

    sudo apt install curl php-cli php-mbstring git unzip curl -sS https://getcomposer.org/installer -o composer-setup.php # Get and set 'HASH' env variable from https://composer.github.io/pubkeys.html php -r "if (hash_file('SHA384', 'composer-setup.php') === '$HASH') { echo 'Installer verified'; } else { echo 'Installer corrupt'; unlink('composer-setup.php'); } echo PHP_EOL;"

  8. 20181213.1238
  9. bash|linux > Creating Incremental Backups with Tar (-g metafile.snar) - [s]

  10. 20181210.0844
  11. python - Print the complete string of a pandas dataframe (.values) - [s]

  12. 20181202.0946
  13. Ubuntu Japanese IME Mozc shortcut to change the input mode from direct to hiragana - [s]

  14. 20181130.1402
  15. python|pandas > plot - [s]

  16. 20181130.1236
  17. Ubuntu 16/18 > /etc/rc.local status check and log - [s]

    systemctl status rc-local.service

  18. 20181126.1924
  19. python > concurrent multi-threading multi-process multithreads multiprocess - [s]

  20. 20181126.1916
  21. linux|ubuntu|bash - Why doesn't the `time` command work with any option? - [s]

  22. 20181126.1840
  23. python|jupyter > add custom magic and kernel - [s]

  24. 20181126.1351
  25. python|pandas|jupyter > concat|concatenate|append dataframes - [s]

  26. 20181126.1100
  27. python|jupyter|pandas > check if same value exist in a column - [s]

    df = pd.DataFrame([{"datetime":1, "query":"SELECT 1"}, {"datetime":2, "query":"SHOW TABLES"},]) df[df['query'].isin(['SELECT 11'])].empty True # If empty, returning True

  28. 20181125.0903
  29. python|jupyter > Built-in magic commands - [s]

    %alias Define an alias for a system command. %config Class[.trait=value] configure IPython %debug [--breakpoint FILE:LINE] [statement [statement ...]] Activate the interactive debugger. %history Print input history (_i<n> variables), with most recent last. %page Pretty print the object and display it through a pager. %pprint Toggle pretty printing on/off. %quickref Show a quick reference sheet

  30. 20181122.1701
  31. SQLite > unix timestamp | unixtimestamp - [s]

    (julianday('now') - 2440587.5)*86400.0

  32. 20181122.1535
  33. python|jupyter|pandas > %matplotlib inline - [s]

    jupyter notebook --matplotlib inline

  34. 20181122.1352
  35. jupyter|pandas > How to set the pandas dataframe data left/right alignment? - [s]

  36. 20181119.1504
  37. python > List Comprehensions in Python - [s]

    [ expression for item in list if conditional ] This is equivalent to: for item in list: if conditional: expression (against a list)

[s] hadoop (5)
[s] public (19)