| BML-S | Help Login

Last entries

    20181214.0721

  1. spark|spark-sql|hive > Caused by: java.lang.NumberFormatException: For input string: "0012050_0000" - [s]

    https://issues.apache.org/jira/browse/SPARK-15348 : Hive ACID (support) https://issues.apache.org/jira/browse/SPARK-16996 : Hive ACID delta files not seen spark.conf.set("hive.transactional.table.scan", "true") spark.conf.set("schema.evolution.columns","key,value") spark.conf.set("schema.evolution.columns.types", "int,int")

    2. 20181211.1056

  2. how to set spark.sql.thriftServer.incrementalCollect=true - Stack Overflow - [s]

    3. 20181210.1726

  3. hadoop - Plain authentication failed: User yarn is not configured for any impersonation. impersonationUser: root in alluxio mapreduce - Stack Overflow - [s]

    alluxio.master.security.impersonation.root.users=* alluxio.master.security.impersonation.root.groups=* alluxio.master.security.impersonation.client.users=* alluxio.master.security.impersonation.client.groups=* alluxio.security.login.impersonation.username=none

    4. 20181207.1549

  4. Ranger permissions to create temporary function (set * in database) - [s]

    5. 20181207.0939

  5. Installing Older Versions of Cloudera Manager 5 | 5.5.x - [s]

    #How to download old/older/archived java. Get link from the browser then: curl -o jdk-8u161-linux-x64.rpm https://download.oracle.com/otn/java/jdk/8u161-b12/2f38c3b165be4555a1fa6e98c45e0808/jdk-8u161-linux-x64.rpm?AuthParam=xxxxxx # vim /etc/yum.repos.d/cloudera-manager.repo [cloudera-manager] name = Cloudera Manager, Version 5.10.1 baseurl = https://archive.cloudera.com/cm5/redhat/7/x86_64/cm/5.10.1/ gpgkey = https://archive.cloudera.com/redhat/cdh/RPM-GPG-KEY-cloudera gpgcheck = 0 yum install cloudera-manager-daemons cloudera-manager-server cloudera-manager-server-db-2 service cloudera-scm-server-db start service cloudera-scm-server start

    20181217.0936

  1. python2|python3 > URL query parameters to dict python - [s]

    python -c 'import os try: from urllib import parse except ImportError: import urlparse as parse url = os.environ["SHELLINABOX_URL"] result = parse.parse_qs(parse.urlsplit(url).query) print(result) '

    2. 20181214.1336

  2. html|javascript > How to display Base64 images in HTML? - [s]

    # Also how to generate from copy and paste of clipboard: https://gist.github.com/STRd6/5286415

    3. 20181214.1314

  3. Better Markdown Parser in PHP - [s]

    https://github.com/erusev/parsedown/blob/master/Parsedown.php

    4. 20181214.1313

  4. php > How To Install and Use Composer on Ubuntu 18.04 - [s]

    sudo apt install curl php-cli php-mbstring git unzip curl -sS https://getcomposer.org/installer -o composer-setup.php # Get and set 'HASH' env variable from https://composer.github.io/pubkeys.html php -r "if (hash_file('SHA384', 'composer-setup.php') === '$HASH') { echo 'Installer verified'; } else { echo 'Installer corrupt'; unlink('composer-setup.php'); } echo PHP_EOL;"

    5. 20181213.1238

  5. bash|linux > Creating Incremental Backups with Tar (-g metafile.snar) - [s]

    6. 20181210.0844

  6. python - Print the complete string of a pandas dataframe (.values) - [s]

    7. 20181202.0946

  7. Ubuntu Japanese IME Mozc shortcut to change the input mode from direct to hiragana - [s]

    8. 20181130.1402

  8. python|pandas > plot - [s]

    9. 20181130.1236

  9. Ubuntu 16/18 > /etc/rc.local status check and log - [s]

    systemctl status rc-local.service

    10. 20181126.1924

  10. python > concurrent multi-threading multi-process multithreads multiprocess - [s]

    11. 20181126.1916

  11. linux|ubuntu|bash - Why doesn't the `time` command work with any option? - [s]

    12. 20181126.1840

  12. python|jupyter > add custom magic and kernel - [s]

    13. 20181126.1351

  13. python|pandas|jupyter > concat|concatenate|append dataframes - [s]

    14. 20181126.1100

  14. python|jupyter|pandas > check if same value exist in a column - [s]

    df = pd.DataFrame([{"datetime":1, "query":"SELECT 1"}, {"datetime":2, "query":"SHOW TABLES"},]) df[df['query'].isin(['SELECT 11'])].empty True # If empty, returning True

    15. 20181125.0903

  15. python|jupyter > Built-in magic commands - [s]

    %alias Define an alias for a system command. %config Class[.trait=value] configure IPython %debug [--breakpoint FILE:LINE] [statement [statement ...]] Activate the interactive debugger. %history Print input history (_i<n> variables), with most recent last. %page Pretty print the object and display it through a pager. %pprint Toggle pretty printing on/off. %quickref Show a quick reference sheet

    16. 20181122.1701

  16. SQLite > unix timestamp | unixtimestamp - [s]

    (julianday('now') - 2440587.5)*86400.0

    17. 20181122.1535

  17. python|jupyter|pandas > %matplotlib inline - [s]

    jupyter notebook --matplotlib inline

    18. 20181122.1352

  18. jupyter|pandas > How to set the pandas dataframe data left/right alignment? - [s]

    19. 20181119.1504

  19. python > List Comprehensions in Python - [s]

    [ expression for item in list if conditional ] This is equivalent to: for item in list: if conditional: expression (against a list)

[s] hadoop (5)
[s] public (19)